00000100:00100000:0.0F:1788530499.596494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0F:1788530499.596653:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718144 00000100:00100000:2.0:1788530499.596672:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718144 00000100:00100000:2.0:1788530499.596750:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:2.0:1788530499.596762:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531718144:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530499.596849:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531718144:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.596857:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:0.0:1788530499.597591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530499.597787:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718528 00000100:00100000:0.0:1788530499.597792:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718528 00000100:00100000:0.0:1788530499.597831:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719040 00000100:00100000:0.0:1788530499.597835:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719040 00000100:00100000:0.0:1788530499.597847:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719168 00000100:00100000:0.0:1788530499.597849:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719168 00000100:00100000:2.0:1788530499.598036:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718656 00000100:00100000:2.0:1788530499.598041:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718656 00000100:00100000:2.0:1788530499.598064:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530499.598072:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531718656:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530499.598141:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531718656:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.598148:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530499.598165:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1788530499.598172:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2398:x1875409531718528:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530499.598196:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c19 00000100:00080000:2.0:1788530499.598214:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530499.598266:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788530499.598418:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+2:2398:x1875409531718528:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 247us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.598425:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1788530499.598440:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1788530499.598448:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2398:x1875409531719040:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530499.598460:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c5f 00000100:00080000:2.0:1788530499.598465:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530499.598501:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788530499.598555:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+2:2398:x1875409531719040:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 105us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.598588:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1788530499.598601:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:2.0:1788530499.598608:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2398:x1875409531719168:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530499.598619:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c66 00000100:00080000:2.0:1788530499.598627:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b053000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530499.598651:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788530499.598719:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+2:2398:x1875409531719168:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 111us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.598726:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00010000:00010000:2.0:1788530499.598750:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530499.598758:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530499.598763:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530499.599102:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718400 00000100:00100000:0.0:1788530499.599109:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718400 00000100:00100000:0.0:1788530499.599157:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718784 00000100:00100000:0.0:1788530499.599161:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718784 00000100:00100000:0.0:1788530499.599175:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718272 00000100:00100000:0.0:1788530499.599178:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718272 00000100:00100000:0.0:1788530499.599189:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718912 00000100:00100000:0.0:1788530499.599191:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718912 00000100:00100000:0.0:1788530499.599205:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1788530499.599211:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531718400:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530499.599242:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531718400:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.599249:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1788530499.599261:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:0.0:1788530499.599266:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531718784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530499.599303:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531718784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.599310:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:0.0:1788530499.599321:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:0.0:1788530499.599327:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+26:2400:x1875409531718272:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530499.599352:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+26:2400:x1875409531718272:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.599358:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:0.0:1788530499.599368:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:0.0:1788530499.599374:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531718912:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530499.599394:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531718912:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.599401:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00080000:0.0:1788530499.599435:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530499.599439:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530499.599442:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530499.599444:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530499.648854:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530499.648949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788530499.649230:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932544 00000100:00100000:1.0:1788530499.649254:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932544 00000100:00100000:1.0:1788530499.649339:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788530499.649354:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530499.649388:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530499.649462:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530499.649470:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788530499.649497:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530499.649540:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932544:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788530499.650247:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530499.650377:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555932672:0@lo:400:kworker.0 00000100:00100000:1.0:1788530499.650430:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.650597:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932672 00000100:00100000:2.0:1788530499.650603:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932672 00000100:00100000:2.0:1788530499.650637:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788530499.650645:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555932672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657549:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932800:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657632:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555933312:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657708:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555933824:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657796:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788530499.657802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932928:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555933440:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657890:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555933952:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.657910:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530499.657942:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932800 00000100:00100000:0.0:1788530499.657950:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932800 00000100:00100000:0.0:1788530499.657995:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933312 00000100:00100000:0.0:1788530499.657999:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933312 00000100:00100000:0.0:1788530499.658014:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788530499.658022:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658083:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932800:12345-0@lo:400:kworker.0 Request processed in 61us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658091:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788530499.658108:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788530499.658114:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555933312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658140:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555933312:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658145:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788530499.658163:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932928 00000100:00100000:0.0:1788530499.658166:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932928 00000100:00100000:0.0:1788530499.658204:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933440 00000100:00100000:0.0:1788530499.658207:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933440 00000100:00100000:0.0:1788530499.658225:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530499.658240:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658273:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932928:12345-0@lo:400:kworker.0 Request processed in 35us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658279:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530499.658291:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788530499.658297:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555933440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658322:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555933440:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658329:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788530499.658356:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933824 00000100:00100000:0.0:1788530499.658360:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933824 00000100:00100000:0.0:1788530499.658384:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933952 00000100:00100000:0.0:1788530499.658388:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933952 00000100:00100000:0.0:1788530499.658407:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530499.658413:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555933824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658441:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555933824:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658447:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530499.658458:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530499.658464:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555933952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658489:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555933952:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.658494:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530499.658544:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932928:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555933440:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658600:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555933952:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932800:0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.658617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555933312:0@lo:400:kworker.0 00010000:00080000:0.0:1788530499.658628:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3ea00 x1875409555933824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530499.658638:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555933824:0@lo:400:kworker.0 00000100:00080000:0.0:1788530499.658729:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530499.658734:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530499.658737:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530499.660801:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555932672:12345-0@lo:400:kworker.0 Request processed in 10147us (10362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.660815:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788530499.660880:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555933056:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.660942:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.660969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555933568:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.661008:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.661029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555934080:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.661536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.661590:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530499.661598:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555933184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.661627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.661644:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555933696:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.661676:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.661692:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555934208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530499.661832:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530499.661885:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933568 00000100:00100000:2.0:1788530499.661894:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933568 00000100:00100000:2.0:1788530499.661939:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934080 00000100:00100000:2.0:1788530499.661942:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934080 00000100:00100000:2.0:1788530499.661964:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933184 00000100:00100000:2.0:1788530499.661967:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933184 00000100:00100000:2.0:1788530499.661978:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933696 00000100:00100000:2.0:1788530499.661980:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933696 00000100:00100000:2.0:1788530499.661998:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788530499.662006:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555933568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662147:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555933568:12345-0@lo:400:kworker.0 Request processed in 140us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.662155:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788530499.662172:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788530499.662178:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555934080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662208:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555934080:12345-0@lo:400:kworker.0 Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.662226:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788530499.662238:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788530499.662245:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662274:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555933184:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.662280:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788530499.662291:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530499.662298:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662323:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555933696:12345-0@lo:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530499.662329:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530499.662369:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555933184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662380:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555933696:0@lo:400:kworker.0 00000100:00100000:2.0:1788530499.662391:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555933568:0@lo:400:kworker.0 00010000:00080000:2.0:1788530499.662403:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03764000 x1875409555934080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530499.662413:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555934080:0@lo:400:kworker.0 00000100:00080000:0.0:1788530499.663223:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530499.663229:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530499.663248:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555933056 00000100:00100000:0.0:1788530499.663254:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555933056 00000100:00100000:0.0:1788530499.663311:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530499.663318:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555933056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530499.663398:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555933056:12345-0@lo:400:kworker.0 Request processed in 80us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.663406:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530499.663463:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934208 00000100:00100000:0.0:1788530499.663467:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934208 00000100:00100000:0.0:1788530499.663491:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530499.663496:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555934208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530499.663513:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788530499.663543:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555934208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530499.663586:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788530499.669838:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530499.669912:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788530499.669923:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e037d5c00, transno 8589934596 00000004:00080000:2.0:1788530499.669937:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788530499.669980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555934208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530499.669996:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555933056:0@lo:400:kworker.0 00000100:00100000:1.0:1788530499.670422:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555932672:0@lo:400:kworker.0 00010000:00010000:3.0F:1788530500.682350:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788530501.190713:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788530501.190746:0:17139:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f3b007f00 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788530501.190752:0:17139:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f17d70e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f3b007cc0 00000020:00080000:3.0:1788530501.190756:0:17139:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f17d70a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e0318be00 00000020:00080000:0.0:1788530501.190795:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1788530501.190884:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788530501.190933:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.190947:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.190957:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.190964:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530501.190969:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.190978:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.190999:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:2.0:1788530501.191003:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530501.191009:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530501.191015:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530501.702882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530501.702970:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530501.703032:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934336 00000100:00100000:2.0:1788530501.703040:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934336 00000100:00100000:2.0:1788530501.703092:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530501.703102:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555934336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530501.703146:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530501.703209:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555934336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530501.703216:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788530501.703237:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788530501.703293:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530501.703434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530502.210011:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555934464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530502.210089:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530502.210166:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530502.210176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555934592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530502.210203:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530502.210237:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934464 00000100:00100000:0.0:1788530502.210247:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934464 00000100:00100000:0.0:1788530502.210298:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934592 00000100:00100000:0.0:1788530502.210301:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934592 00000100:00100000:0.0:1788530502.210320:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788530502.210329:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555934464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530502.210368:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530502.210416:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555934464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530502.210424:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788530502.210445:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530502.210452:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555934592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530502.210471:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788530502.210505:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555934592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530502.210512:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530502.210558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555934592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530502.210631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555934464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530502.448833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530502.448880:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719296 00000100:00100000:3.0:1788530502.448890:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719296 00000100:00100000:3.0:1788530502.448968:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:3.0:1788530502.448979:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+12:15609:x1875409531719296:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788530502.449089:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530502.449111:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+12:15609:x1875409531719296:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 133us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530502.449119:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:3.0:1788530502.461989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530502.462028:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719424 00000100:00100000:3.0:1788530502.462037:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719424 00000100:00100000:3.0:1788530502.462093:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:3.0:1788530502.462103:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15609:x1875409531719424:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788530502.462200:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15609:x1875409531719424:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 98us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530502.462208:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00080000:1.0:1788530502.463875:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530502.480343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530502.489715:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719680 00000100:00100000:3.0:1788530502.489735:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719680 00000100:00100000:3.0:1788530502.489810:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1788530502.489823:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+12:15609:x1875409531719680:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788530502.490092:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+13:15609:x1875409531719680:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 271us (9763us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788530502.490112:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530502.722254:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530502.722283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555934720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530502.722376:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530502.722439:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934720 00000100:00100000:0.0:1788530502.722447:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934720 00000100:00100000:0.0:1788530502.722511:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788530502.722521:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555934720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530502.722547:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530502.722620:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555934720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530502.722628:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788530502.722679:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555934720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788530502.723916:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788530502.735541:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530503.745049:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530504.684258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530504.684308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530504.684337:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530504.684356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530504.684375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530504.684399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530504.684471:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719808 00000100:00100000:1.0:1788530504.684482:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719808 00000100:00100000:1.0:1788530504.684538:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:1.0:1788530504.684550:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531719808:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530504.684644:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531719808:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.684652:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:0.0:1788530504.691234:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720064 00000100:00100000:0.0:1788530504.691253:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720064 00000100:00100000:0.0:1788530504.691390:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720320 00000100:00100000:0.0:1788530504.691394:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720320 00000100:00100000:0.0:1788530504.691410:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531719936 00000100:00100000:0.0:1788530504.691413:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531719936 00000100:00100000:0.0:1788530504.691425:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720448 00000100:00100000:0.0:1788530504.691428:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720448 00000100:00100000:0.0:1788530504.691450:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:0.0:1788530504.691460:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531720064:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530504.691540:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531720064:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (7231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.691548:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:0.0:1788530504.691603:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:0.0:1788530504.691623:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531720320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530504.691652:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531720320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (7314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.692266:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:3.0:1788530504.692299:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:0.0:1788530504.697107:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:0.0:1788530504.697144:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531720448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530504.697252:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531720448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 128us (12851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.697261:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:0.0:1788530504.699587:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720192 00000100:00100000:0.0:1788530504.699602:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720192 00000100:00100000:0.0:1788530504.699995:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1788530504.700007:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531720192:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530504.700100:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531720192:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 95us (15723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.700109:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00080000:0.0:1788530504.700150:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530504.700158:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530504.700163:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530504.701962:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+13:2400:x1875409531719936:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530504.709205:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+13:2400:x1875409531719936:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 16882us (24833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530504.709224:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 96 00010000:00010000:2.0:1788530504.768765:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530504.768765:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530504.768789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555934848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530504.768872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530504.768973:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934848 00000100:00100000:2.0:1788530504.768983:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934848 00000100:00100000:2.0:1788530504.769058:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530504.769069:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555934848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530504.769113:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530504.769167:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555934848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530504.769175:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530504.769226:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555934848:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788530504.769404:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530504.770306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555935232:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.770385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530504.770400:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555935104:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.770441:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555935744:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.770443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530504.770480:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555935616:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.770482:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530504.770513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555936256:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.770519:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530504.770590:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555935360:0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.770662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555934976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530504.771676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555936128:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.773171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530504.773287:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935232 00000100:00100000:0.0:1788530504.773300:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935232 00000100:00100000:0.0:1788530504.774156:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935744 00000100:00100000:0.0:1788530504.774167:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935744 00000100:00100000:0.0:1788530504.774198:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788530504.774208:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555935232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.774307:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555935232:12345-0@lo:400:kworker.0 Request processed in 99us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.774314:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788530504.775222:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788530504.775238:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555935744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.775293:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555935744:12345-0@lo:400:kworker.0 Request processed in 61us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.775300:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788530504.775358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555935744:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.775372:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555935232:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.775401:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935616 00000100:00100000:0.0:1788530504.775406:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935616 00000100:00100000:0.0:1788530504.775453:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936256 00000100:00100000:0.0:1788530504.775456:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936256 00000100:00100000:0.0:1788530504.775496:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788530504.775503:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555935616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.776634:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555935616:12345-0@lo:400:kworker.0 Request processed in 1127us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.776644:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788530504.776696:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788530504.776706:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555936256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.776761:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555936256:12345-0@lo:400:kworker.0 Request processed in 58us (3601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.776767:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1788530504.776897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37364a80 x1875409555936256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530504.776911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555936256:0@lo:400:kworker.0 00000100:00080000:0.0:1788530504.776956:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530504.776984:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935104 00000100:00100000:0.0:1788530504.776989:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935104 00000100:00100000:0.0:1788530504.777091:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788530504.777099:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555935104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.777132:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555935104:12345-0@lo:400:kworker.0 Request processed in 34us (6690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530504.777138:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788530504.777416:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530504.777463:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555935872:0@lo:400:kworker.0 00000100:00100000:3.0:1788530504.777493:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530504.777537:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935360 00000100:00100000:3.0:1788530504.777538:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935872 00000100:00100000:0.0:1788530504.777543:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935360 00000100:00100000:3.0:1788530504.777545:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935872 00000100:00100000:0.0:1788530504.777614:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530504.777624:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555935360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.777673:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555935360:12345-0@lo:400:kworker.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530504.777856:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530504.777867:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555935872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530504.777905:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555935872:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.777981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530504.778023:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555934976 00000100:00100000:1.0:1788530504.778027:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555934976 00000100:00100000:1.0:1788530504.778064:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530504.778072:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555934976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530504.778098:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530504.778132:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555934976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.778139:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530504.778184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555934976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530504.778193:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555935488:0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778217:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530504.778231:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555936000:0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778255:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530504.778277:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936000 00000100:00100000:1.0:1788530504.778281:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936000 00000100:00100000:1.0:1788530504.778311:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788530504.778318:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555936000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778348:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555936000:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.778354:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788530504.778383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555936000:0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778391:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555936512:0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530504.778450:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936512 00000100:00100000:1.0:1788530504.778453:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936512 00000100:00100000:1.0:1788530504.778480:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788530504.778487:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555936512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.778517:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555936512:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.778523:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1788530504.778548:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37364380 x1875409555936512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530504.778579:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555936512:0@lo:400:kworker.0 00000100:00080000:1.0:1788530504.778620:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530504.778639:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530504.778641:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530504.782202:0:18966:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530504.782226:0:18966:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788530504.782438:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555935488 00000100:00100000:1.0:1788530504.782448:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555935488 00000100:00100000:2.0:1788530504.782603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530504.782935:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555935104:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.782962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555935616:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783005:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936128 00000100:00100000:2.0:1788530504.783019:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936128 00000100:00080000:2.0:1788530504.783044:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530504.783084:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530504.783100:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555936128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783163:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555936128:12345-0@lo:400:kworker.0 Request processed in 65us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530504.783170:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530504.783206:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555936128:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783252:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555935872:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783264:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555936384:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530504.783322:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936384 00000100:00100000:2.0:1788530504.783325:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936384 00000100:00100000:2.0:1788530504.783353:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788530504.783359:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555936384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783388:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555936384:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530504.783395:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788530504.783408:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530504.783425:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555936384:0@lo:400:kworker.0 00000100:00100000:2.0:1788530504.783448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555935360:0@lo:400:kworker.0 00000100:00100000:0.0:1788530504.786041:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530504.787806:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788530504.787986:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530504.788004:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555935488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530504.788104:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555935488:12345-0@lo:400:kworker.0 Request processed in 108us (9885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530504.788111:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788530504.788189:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555935488:0@lo:400:kworker.0 00000001:00100000:3.0:1788530505.283660:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:1.0:1788530505.283661:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000020:00000080:3.0:1788530505.283673:0:18663:0:(genops.c:885:class_export_put()) final put ffff9a9f047fb000/5fa0991a-e80a-4f33-96cf-7430c54598af 00000020:00000080:1.0:1788530505.283673:0:19495:0:(genops.c:885:class_export_put()) final put ffff9a9f3b052000/5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:3.0:1788530505.283704:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:3.0:1788530505.283707:0:18663:0:(genops.c:885:class_export_put()) final put ffff9a9f047f8800/66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:0.0:1788530505.283725:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3b052000/5fa0991a-e80a-4f33-96cf-7430c54598af for lustre-OST0001 00000020:00000080:0.0:1788530505.283779:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047fb000/5fa0991a-e80a-4f33-96cf-7430c54598af for lustre-OST0000 00000020:00000080:0.0:1788530505.283795:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047f8800/66d42348-56b8-4977-9cd3-df6ed37388a6 for lustre-OST0000 00000020:00000080:0.0:1788530505.283834:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3b053000 for lustre-OST0001 00000020:00000080:0.0:1788530505.283839:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f047fe800 for lustre-OST0000 00000020:00000080:0.0:1788530505.283842:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f047fd800 for lustre-OST0000 00010000:00010000:3.0:1788530505.792908:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530506.816803:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530506.816899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555936640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530506.816975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530506.817033:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936640 00000100:00100000:3.0:1788530506.817041:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936640 00000100:00100000:3.0:1788530506.817100:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530506.817110:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555936640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530506.817139:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530506.817181:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555936640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530506.817188:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530506.817230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555936640:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788530506.817288:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788530506.819350:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1788530506.819364:0:17139:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1788530506.819431:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1788530506.819443:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:02000400:3.0:1788530507.040143:0:20555:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:01:44 (1788530504) 00000100:00100000:3.0:1788530507.332202:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530507.332222:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555936768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530507.332225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555936896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530507.332306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530507.332358:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936768 00000100:00100000:3.0:1788530507.332369:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936768 00000100:00100000:0.0:1788530507.332385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530507.332422:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555936896 00000100:00100000:3.0:1788530507.332426:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555936896 00000100:00100000:0.0:1788530507.334220:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788530507.334239:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555936768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530507.334282:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530507.334376:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555936768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530507.334383:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788530507.334406:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788530507.334412:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555936896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530507.334429:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788530507.334463:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555936896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530507.334469:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788530507.334518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555936896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530507.334627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555936768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530507.841737:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555937024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530507.841842:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530507.841919:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937024 00000100:00100000:0.0:1788530507.841931:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937024 00000100:00100000:0.0:1788530507.842019:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530507.842058:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555937024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530507.842101:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530507.842161:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555937024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530507.842169:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530507.842279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555937024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530507.842365:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788530507.842500:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530508.427067:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788530508.610304:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788530508.610324:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530508.610361:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788530508.610377:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788530508.865280:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530509.803334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803451:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530509.803504:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720704 00000100:00100000:3.0:1788530509.803516:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720704 00000100:00100000:3.0:1788530509.803602:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721216 00000100:00100000:3.0:1788530509.803606:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721216 00000100:00100000:3.0:1788530509.803620:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720832 00000100:00100000:3.0:1788530509.803622:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720832 00000100:00100000:3.0:1788530509.803630:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721088 00000100:00100000:3.0:1788530509.803632:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721088 00000100:00100000:3.0:1788530509.803646:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:3.0:1788530509.803654:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+12:2399:x1875409531720704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530509.803742:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+12:2399:x1875409531720704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.803751:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:3.0:1788530509.803778:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:3.0:1788530509.803786:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531721216:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530509.803812:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531721216:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.803818:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:3.0:1788530509.803829:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:3.0:1788530509.803835:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531720832:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530509.803872:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531720832:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.803879:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:3.0:1788530509.803891:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:3.0:1788530509.803897:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2399:x1875409531721088:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530509.803920:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2399:x1875409531721088:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.803925:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:3.0:1788530509.803946:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720576 00000100:00100000:3.0:1788530509.803949:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720576 00000100:00100000:3.0:1788530509.803973:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1788530509.803980:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:2399:x1875409531720576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530509.804007:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:2399:x1875409531720576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.804014:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00080000:1.0:1788530509.804059:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530509.804064:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530509.804962:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531720960 00000100:00100000:0.0:1788530509.805236:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531720960 00000100:00100000:0.0:1788530509.805354:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1788530509.805366:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2399:x1875409531720960:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530509.805435:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2399:x1875409531720960:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 72us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530509.805443:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00080000:1.0:1788530509.806338:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530509.889254:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555937152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530509.889353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530509.889436:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937152 00000100:00100000:1.0:1788530509.889448:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937152 00000100:00100000:1.0:1788530509.889548:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530509.889582:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555937152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530509.889624:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530509.889682:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555937152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530509.889689:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788530509.889734:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530509.889961:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555937408:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.890048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555937920:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890079:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.890097:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555938432:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530509.890163:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530509.890175:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530509.890181:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555937536:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.890238:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555938048:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530509.890261:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937920 00000100:00100000:1.0:1788530509.890266:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937920 00000100:00100000:2.0:1788530509.890278:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555938560:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890298:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530509.890304:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937536 00000100:00100000:1.0:1788530509.890307:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937536 00000100:00100000:1.0:1788530509.890326:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938048 00000100:00100000:1.0:1788530509.890329:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938048 00000100:00100000:2.0:1788530509.890330:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937408 00000100:00100000:2.0:1788530509.890333:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937408 00000100:00100000:1.0:1788530509.890344:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530509.890351:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555937920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.890360:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530509.890366:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.890428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555937664:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.891587:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555937408:12345-0@lo:400:kworker.0 Request processed in 1214us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.891600:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530509.891647:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530509.891660:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555937536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.891704:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555937536:12345-0@lo:400:kworker.0 Request processed in 49us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.891725:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530509.891740:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530509.891747:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555938048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.891792:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555938048:12345-0@lo:400:kworker.0 Request processed in 45us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.891797:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530509.891819:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938432 00000100:00100000:2.0:1788530509.891824:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938432 00000100:00100000:2.0:1788530509.891860:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938560 00000100:00100000:2.0:1788530509.891863:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938560 00000100:00100000:2.0:1788530509.891884:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788530509.891890:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555938432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.891919:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555938432:12345-0@lo:400:kworker.0 Request processed in 30us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.891925:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788530509.891935:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788530509.891941:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555938560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.891969:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555938560:12345-0@lo:400:kworker.0 Request processed in 28us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.891975:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788530509.891995:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530509.892000:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530509.892002:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530509.892006:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530509.892178:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555937280:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.892262:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555937792:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892291:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.892313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555938304:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892339:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.892355:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555938816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530509.892377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530509.892411:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937280 00000100:00100000:2.0:1788530509.892414:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937280 00000100:00100000:2.0:1788530509.892443:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788530509.892450:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555937280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892501:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555937280:12345-0@lo:400:kworker.0 Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.892508:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788530509.892537:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938304 00000100:00100000:2.0:1788530509.892541:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938304 00000100:00100000:2.0:1788530509.892599:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788530509.892606:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555938304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892639:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555938304:12345-0@lo:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.892645:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788530509.892664:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938816 00000100:00100000:2.0:1788530509.892667:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938816 00000100:00100000:2.0:1788530509.892693:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530509.892699:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555938816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530509.892716:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530509.892751:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555938816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.892780:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788530509.892798:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530509.892824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555937280:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892836:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555938304:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892849:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555938816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530509.892882:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555937536:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892892:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555938048:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892901:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555938560:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.892911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555937408:0@lo:400:kworker.0 00010000:00080000:2.0:1788530509.892924:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37367800 x1875409555938432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530509.892934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555938432:0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.893680:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937792 00000100:00100000:2.0:1788530509.893689:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937792 00000100:00100000:2.0:1788530509.893731:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530509.893741:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555937792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530509.893812:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555937792:12345-0@lo:400:kworker.0 Request processed in 74us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530509.893819:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530509.893822:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555937920:12345-0@lo:400:kworker.0 Request processed in 3469us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530509.893832:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530509.893858:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555937792:0@lo:400:kworker.0 00000100:00100000:1.0:1788530509.893888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555937920:0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894121:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530509.894164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555938176:0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894192:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530509.894218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555938688:0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530509.894304:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555937152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530509.894325:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555937664 00000100:00100000:3.0:1788530509.894328:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938176 00000100:00100000:1.0:1788530509.894330:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555937664 00000100:00100000:3.0:1788530509.894331:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938176 00000100:00100000:1.0:1788530509.894357:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938688 00000100:00100000:1.0:1788530509.894360:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938688 00000100:00100000:3.0:1788530509.894403:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530509.894410:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555937664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894446:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555937664:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.894452:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530509.894463:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530509.894468:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555938176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894586:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555938176:12345-0@lo:400:kworker.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530509.894593:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530509.894631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555937664:0@lo:400:kworker.0 00000100:00100000:3.0:1788530509.894639:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555938176:0@lo:400:kworker.0 00000100:00100000:1.0:1788530509.894731:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788530509.894738:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555938688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530509.894788:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555938688:12345-0@lo:400:kworker.0 Request processed in 50us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530509.894800:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788530509.895196:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788530509.895220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37366300 x1875409555938688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530509.895232:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555938688:0@lo:400:kworker.0 00010000:00010000:0.0:1788530510.913450:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530511.937876:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530511.938973:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f39879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555938944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530511.939063:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530511.939860:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555938944 00000100:00100000:2.0:1788530511.939886:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555938944 00000100:00100000:2.0:1788530511.939957:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530511.939967:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555938944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530511.939997:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530511.940056:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555938944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530511.940064:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788530511.940143:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530511.943725:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f39879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555938944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530512.106467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530512.106519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530512.106546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530512.106624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530512.106824:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721344 00000100:00100000:0.0:1788530512.106836:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721344 00000100:00100000:0.0:1788530512.106928:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721472 00000100:00100000:0.0:1788530512.106932:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721472 00000100:00100000:0.0:1788530512.106949:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721600 00000100:00100000:0.0:1788530512.106952:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721600 00000100:00100000:0.0:1788530512.106962:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721728 00000100:00100000:0.0:1788530512.106965:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721728 00000100:00100000:0.0:1788530512.106984:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1788530512.107005:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+17:2400:x1875409531721344:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530512.107036:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530512.107064:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c31 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530512.107090:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530512.107165:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+16:2400:x1875409531721344:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 162us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.107174:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1788530512.107194:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530512.107202:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+15:2400:x1875409531721472:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530512.107211:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530512.107221:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c62 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530512.107230:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530512.107251:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531721472:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 51us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.107257:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530512.107281:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1788530512.107288:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+13:2400:x1875409531721600:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530512.107294:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530512.107303:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751cc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d1f expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530512.107313:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530512.107337:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+12:2400:x1875409531721600:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 50us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.107343:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1788530512.107356:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530512.107362:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+11:2400:x1875409531721728:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530512.107369:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530512.107377:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125751bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c2a expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530512.107386:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530512.107402:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc207521-3937-4a55-9052-ed3c297904d3+10:2400:x1875409531721728:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 41us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.107407:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1788530512.114130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530512.114219:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531721984 00000100:00100000:3.0:1788530512.114230:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531721984 00000100:00100000:3.0:1788530512.114312:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530512.114325:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2398:x1875409531721984:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:3.0:1788530512.114379:0:18666:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c20 00000020:00010000:3.0:1788530512.114388:0:18666:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9f047ff000: total 0 00000100:00080000:3.0:1788530512.114394:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9a9f047f8000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788530512.114460:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788530512.117073:0:18666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788530512.117300:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+4:2398:x1875409531721984:12345-192.168.202.41@tcp:9:umount.0 Request processed in 2972us (3296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530512.117313:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000020:00010000:0.0:1788530512.125853:0:18991:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9f047ff000: total 0 00010000:00010000:0.0:1788530512.125930:0:18991:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9f047ff000, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788530512.125966:0:18991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788530512.125969:0:18991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788530493 -> 1788530494 00002000:00010000:0.0:1788530512.125972:0:18991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788530493 -> 1788530494 00002000:00010000:0.0:1788530512.125974:0:18991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788530512.126006:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751f92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dff expref: 3 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530512.126034:0:18991:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9f047ff000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788530512.126047:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530512.126049:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530512.126051:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530512.132453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530512.133237:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531722880 00000100:00100000:2.0:1788530512.133251:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531722880 00000100:00100000:2.0:1788530512.133359:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1788530512.133372:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+12:2398:x1875409531722880:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:2.0:1788530512.133411:0:17160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c0b 00000020:00010000:2.0:1788530512.133428:0:17160:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9e01b17000: total 0 00000100:00080000:2.0:1788530512.133433:0:17160:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b11000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530512.133463:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:0.0:1788530512.133702:0:17147:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9e01b17000: total 0 00010000:00010000:0.0:1788530512.133708:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530512.133728:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+11:2398:x1875409531722880:12345-192.168.202.41@tcp:39:umount.0 Request processed in 359us (1285us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788530512.133737:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00010000:00010000:0.0:1788530512.133769:0:17147:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9e01b17000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788530512.133803:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530512.133808:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530512.133817:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751f3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ddc expref: 10 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134098:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9e03284300) 00010000:00010000:2.0:1788530512.134103:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530512.134108:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2800/0xb28d70e125751cf9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d2d expref: 9 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134131:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530512.134134:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530512.134158:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d3b expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134174:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530512.134176:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530512.134181:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 7 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134194:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530512.134196:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530512.134200:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751fa0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e06 expref: 6 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134216:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9e03284a00) 00010000:00010000:2.0:1788530512.134219:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530512.134222:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d26 expref: 5 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134237:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530512.134239:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788530512.134242:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d65 expref: 4 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530512.134254:0:17147:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9e01b17000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788530512.134269:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530512.134271:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530512.134274:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530512.134445:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530512.162386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530512.162544:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723008 00000100:00100000:1.0:1788530512.162555:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723008 00000100:00100000:1.0:1788530512.162682:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:1.0:1788530512.162695:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2398:x1875409531723008:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1788530512.162728:0:17158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c12 00000100:00080000:1.0:1788530512.162757:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9a9e026c6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530512.162780:0:17158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788530512.163061:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+3:2398:x1875409531723008:12345-192.168.202.41@tcp:39:umount.0 Request processed in 367us (684us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788530512.163070:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00010000:00010000:0.0:1788530512.163530:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530512.163645:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530512.448929:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530512.448956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555939072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530512.449038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530512.449341:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939072 00000100:00100000:0.0:1788530512.449480:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530512.449490:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555939200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530512.449522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530512.449553:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939200 00000100:00100000:0.0:1788530512.449574:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939200 00000100:00100000:0.0:1788530512.449619:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788530512.449627:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555939200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530512.449661:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530512.449704:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555939200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.449711:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788530512.449767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555939200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530512.450023:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939072 00000100:00100000:2.0:1788530512.450049:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530512.450056:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555939072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530512.450075:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788530512.450120:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555939072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530512.450126:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788530512.450454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555939072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530512.961044:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530512.961069:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555939328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530512.961156:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530512.961365:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939328 00000100:00100000:0.0:1788530512.961373:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939328 00000100:00100000:0.0:1788530512.961439:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788530512.961449:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555939328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530512.961472:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530512.961522:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555939328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530512.961543:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788530512.961628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555939328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788530512.962466:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788530512.962524:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530513.984783:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530514.588399:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530514.588457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530514.588590:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723136 00000100:00100000:3.0:1788530514.588602:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723136 00000100:00100000:3.0:1788530514.588683:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723264 00000100:00100000:3.0:1788530514.588686:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723264 00000100:00100000:3.0:1788530514.588732:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530514.588745:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+11:2400:x1875409531723136:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530514.588766:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788530514.588780:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530514.588791:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc207521-3937-4a55-9052-ed3c297904d3+11:2400:x1875409531723264:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530514.588792:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167c00/0xb28d70e125751c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca8 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530514.588799:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530514.588809:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e010a2000/0xb28d70e125751c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550cd9 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530514.588829:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530514.588829:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530514.589001:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+9:2400:x1875409531723136:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 258us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530514.589009:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1788530514.590818:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc207521-3937-4a55-9052-ed3c297904d3+8:2400:x1875409531723264:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 2015us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530514.590834:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1788530514.609892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530514.609946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530514.610003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530514.610042:0:20205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723392 00000100:00100000:2.0:1788530514.610059:0:20205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723392 00000100:00100000:2.0:1788530514.610145:0:20205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723520 00000100:00100000:2.0:1788530514.610148:0:20205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723520 00000100:00100000:3.0:1788530514.610150:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723776 00000100:00100000:3.0:1788530514.610154:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723776 00000100:00100000:2.0:1788530514.610182:0:20205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1788530514.610193:0:20205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc207521-3937-4a55-9052-ed3c297904d3+9:2401:x1875409531723392:12345-192.168.202.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788530514.610198:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:3.0:1788530514.610205:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2398:x1875409531723776:12345-192.168.202.41@tcp:39:umount.0 00010000:00010000:2.0:1788530514.610218:0:20205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530514.610245:0:20205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e125751cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d18 expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788530514.610253:0:17159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c51 00000020:00010000:3.0:1788530514.610280:0:17159:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9f274fa800: total 0 00000100:00080000:3.0:1788530514.610285:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9a9f274ff000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788530514.610298:0:20205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1788530514.610320:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1788530514.610374:0:20205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc207521-3937-4a55-9052-ed3c297904d3+8:2401:x1875409531723392:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 183us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530514.610382:0:20205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1788530514.610403:0:20205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1788530514.610409:0:20205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc207521-3937-4a55-9052-ed3c297904d3+7:2400:x1875409531723520:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530514.610418:0:20205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530514.610427:0:20205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166a00/0xb28d70e125751c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca1 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530514.610457:0:20205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530514.610476:0:20205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc207521-3937-4a55-9052-ed3c297904d3+6:2400:x1875409531723520:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 66us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530514.610479:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2398:x1875409531723776:12345-192.168.202.41@tcp:39:umount.0 Request processed in 274us (476us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788530514.610483:0:20205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1788530514.610486:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00080000:3.0:1788530514.610501:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788530514.614700:0:17148:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9f274fa800: total 0 00010000:00010000:2.0:1788530514.614794:0:17148:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9f274fa800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788530514.614833:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530514.614837:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530514.614848:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d42 expref: 4 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530514.614888:0:17148:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9f274fa800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788530514.614900:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530514.614902:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530514.614904:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530514.624859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530514.625796:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531723904 00000100:00100000:2.0:1788530514.625824:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531723904 00000100:00100000:2.0:1788530514.625904:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:2.0:1788530514.625916:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2398:x1875409531723904:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:2.0:1788530514.625959:0:17160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751c58 00000100:00080000:2.0:1788530514.625980:0:17160:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b054000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530514.626009:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:0.0:1788530514.626118:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530514.626177:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+3:2398:x1875409531723904:12345-192.168.202.41@tcp:39:umount.0 Request processed in 263us (1329us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788530514.626186:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:3.0:1788530514.626199:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530514.671138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530514.671272:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724032 00000100:00100000:0.0:1788530514.671290:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724032 00000100:00100000:0.0:1788530514.671378:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:0.0:1788530514.671391:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+6:2398:x1875409531724032:12345-192.168.202.41@tcp:251:umount.0 00000020:00000080:0.0:1788530514.671444:0:17153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751be8 00000100:00080000:0.0:1788530514.671457:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b12800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788530514.671553:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+1:2398:x1875409531724032:12345-192.168.202.41@tcp:251:umount.0 Request processed in 164us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530514.671597:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000020:00000080:0.0:1788530514.671610:0:17153:0:(genops.c:885:class_export_put()) final put ffff9a9e01b13800/fc207521-3937-4a55-9052-ed3c297904d3 00000020:00000080:0.0:1788530514.671691:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01b13800/fc207521-3937-4a55-9052-ed3c297904d3 for MGS 00000020:00000080:0.0:1788530514.671753:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e01b12800 for MGS 00010000:00010000:1.0:1788530514.672222:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530515.009687:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530515.009712:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555939456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530515.009808:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530515.009886:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939456 00000100:00100000:3.0:1788530515.009896:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939456 00000100:00100000:3.0:1788530515.009958:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530515.009970:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555939456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530515.010025:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788530515.010081:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555939456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530515.010089:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788530515.010127:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530515.010169:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555939456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530515.017310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3987b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555939584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530515.017386:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530515.017457:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530515.017471:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939584 00000100:00100000:2.0:1788530515.017479:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939584 00000100:00100000:2.0:1788530515.017547:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530515.017581:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555939584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530515.017606:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530515.017653:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555939584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.017660:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788530515.017680:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530515.017714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3987b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555939584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530515.018845:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555939712:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.018895:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.018936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555940224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.018962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555940736:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019061:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530515.019067:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555939840:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019089:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019108:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555940352:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555940864:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019164:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019191:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555940096:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019214:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019231:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555940608:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019252:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019270:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788530515.019276:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555939968:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555940480:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019334:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555940992:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530515.019389:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940736 00000100:00100000:2.0:1788530515.019394:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940736 00000100:00100000:2.0:1788530515.019434:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940864 00000100:00100000:2.0:1788530515.019449:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940864 00000100:00100000:2.0:1788530515.019465:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940096 00000100:00100000:2.0:1788530515.019468:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940096 00000100:00100000:2.0:1788530515.019682:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940608 00000100:00100000:2.0:1788530515.019687:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940608 00000100:00100000:2.0:1788530515.019702:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940480 00000100:00100000:2.0:1788530515.019704:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940480 00000100:00100000:2.0:1788530515.019712:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940992 00000100:00100000:2.0:1788530515.019714:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940992 00000100:00100000:2.0:1788530515.019831:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530515.019839:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555940736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019893:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555940736:12345-0@lo:400:kworker.0 Request processed in 54us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.019900:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530515.019917:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788530515.019923:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.019951:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555940864:12345-0@lo:400:kworker.0 Request processed in 29us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.019957:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788530515.019968:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530515.019973:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555940096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020016:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555940096:12345-0@lo:400:kworker.0 Request processed in 42us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020022:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530515.020034:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788530515.020041:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555940608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020067:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555940608:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020073:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788530515.020084:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530515.020098:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555940480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020128:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555940480:12345-0@lo:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020133:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530515.020145:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530515.020151:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555940992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020176:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555940992:12345-0@lo:400:kworker.0 Request processed in 26us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020181:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530515.020200:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940224 00000100:00100000:2.0:1788530515.020203:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940224 00000100:00100000:2.0:1788530515.020235:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939840 00000100:00100000:2.0:1788530515.020238:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939840 00000100:00100000:2.0:1788530515.020252:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530515.020257:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555940224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020302:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555940224:12345-0@lo:400:kworker.0 Request processed in 44us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020308:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530515.020320:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788530515.020327:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3987a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555939840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020352:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3987a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555939840:12345-0@lo:400:kworker.0 Request processed in 27us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530515.020358:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788530515.020376:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530515.020381:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530515.020410:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555939840:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555940864:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.020457:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555940224:0@lo:400:kworker.0 00010000:00080000:2.0:1788530515.020470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f33afed80 x1875409555940736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530515.020481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555940736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530515.020608:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555940352 00000100:00100000:1.0:1788530515.020613:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555940352 00000100:00100000:1.0:1788530515.020649:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939968 00000100:00100000:1.0:1788530515.020652:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939968 00000100:00100000:1.0:1788530515.020673:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788530515.020680:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530515.020725:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555940352:12345-0@lo:400:kworker.0 Request processed in 36us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530515.020732:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788530515.020745:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788530515.020751:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555939968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530515.020777:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555939968:12345-0@lo:400:kworker.0 Request processed in 28us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530515.020783:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788530515.020806:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530515.021002:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555939712 00000100:00100000:3.0:1788530515.021007:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555939712 00000100:00100000:3.0:1788530515.021045:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788530515.021052:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555939712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530515.021087:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555939712:12345-0@lo:400:kworker.0 Request processed in 35us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530515.021093:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788530515.022754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555940352:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.022771:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555939712:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.022808:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555939968:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.022821:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555940480:0@lo:400:kworker.0 00010000:00080000:2.0:1788530515.022835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f33afc700 x1875409555940992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530515.022846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555940992:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.022859:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555940096:0@lo:400:kworker.0 00000100:00100000:2.0:1788530515.022870:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555940608:0@lo:400:kworker.0 00010000:00010000:0.0:1788530516.034090:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788530516.809903:0:20750:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788530516.837467:0:20750:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788530516.837528:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.837545:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.837657:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.837665:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.837685:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530516.837690:0:20750:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788530516.837721:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530516.837725:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788530516.837731:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788530516.837755:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e03636000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788530516.837814:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555941120:0@lo:39:umount.0 00000100:00100000:3.0:1788530516.837882:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530516.837962:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941120 00010000:00010000:1.0:1788530516.838037:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530516.838044:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838052:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530516.838056:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838065:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530516.838072:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530516.838089:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530516.838091:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788530516.838094:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788530516.838136:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838142:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530516.838160:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838166:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838179:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530516.838180:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530516.838182:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530516.838192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555941248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530516.838221:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530516.838258:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941248 00000100:00100000:1.0:1788530516.838263:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941248 00000100:00100000:1.0:1788530516.838316:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530516.838325:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555941248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530516.838337:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530516.838350:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100c00/0xb28d70e125751742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575173b expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530516.838361:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530516.838388:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3650:x1875409555941248:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530516.838400:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530516.838447:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555941248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530516.838683:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941120 00000100:00100000:0.0:1788530516.838732:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788530516.838739:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875409555941120:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788530516.838761:0:18163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575176c 00000100:00080000:0.0:1788530516.838768:0:18163:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaef000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788530516.838844:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530516.844182:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875409555941120:12345-0@lo:39:umount.0 Request processed in 5434us (6289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530516.844217:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1788530516.844233:0:18163:0:(genops.c:885:class_export_put()) final put ffff9a9f0aae9800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788530516.846491:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e03636000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788530516.846515:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555941120:0@lo:39:umount.0 00000100:00080000:0.0:1788530516.847153:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530516.847158:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788530516.847164:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788530516.848132:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848148:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848156:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848162:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848191:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530516.848198:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848205:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848211:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848218:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848253:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788530516.848260:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848267:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848273:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848279:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848303:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788530516.848308:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848315:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848322:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848328:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848336:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788530516.848341:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848358:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848364:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848369:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530516.848376:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788530516.848379:0:20750:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788530516.848416:0:20750:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788530516.848421:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788530516.848425:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530516.848431:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:0.0:1788530516.848440:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9e01b10000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530516.848446:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9e0223a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530516.848450:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9e027aa000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530516.848454:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9f3288b000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530516.848461:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a9f274fa800 5fa0991a-e80a-4f33-96cf-7430c54598af 192.168.202.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788530516.848466:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a9e01b17000 66d42348-56b8-4977-9cd3-df6ed37388a6 192.168.202.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:0.0:1788530516.848471:0:20750:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a9f3d210000) has exports, disconnecting them 00000020:00080000:0.0:1788530516.848476:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9e01b10000), last request at 1788530515 00000020:00000080:0.0:1788530516.848484:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751ac2 00000100:00080000:0.0:1788530516.848504:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b13000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788530516.848587:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e01b10000): rc 0 00000020:00000080:0.0:1788530516.848590:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e01b10000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788530516.848665:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788530516.848672:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848679:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100e00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530516.848683:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848691:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530516.848698:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530516.848727:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788530516.848730:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 10000000:01000000:2.0:1788530516.848732:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788530516.848786:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848794:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530516.848815:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848821:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848833:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788530516.848837:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848841:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91de00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530516.848845:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848851:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530516.848857:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530516.848862:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788530516.848864:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:2.0:1788530516.848871:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788530516.848897:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848903:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530516.848908:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848915:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848924:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788530516.848927:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848931:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530516.848934:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848939:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530516.848945:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530516.848949:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788530516.848951:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:2.0:1788530516.848953:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788530516.848975:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.848980:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530516.848998:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849005:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849014:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530516.849017:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849023:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530516.849025:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849031:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530516.849037:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530516.849042:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788530516.849044:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:2.0:1788530516.849045:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788530516.849067:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849072:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530516.849077:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849083:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849096:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530516.849098:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849104:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530516.849107:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849113:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530516.849119:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530516.849123:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788530516.849125:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788530516.849127:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788530516.849150:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849155:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530516.849159:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849164:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849173:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530516.849174:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530516.849180:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530516.849196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.849258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.849299:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.849321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.849343:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530516.849349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.849370:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.849403:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941376 00000100:00100000:2.0:1788530516.849409:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941376 00000100:00100000:2.0:1788530516.849453:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941888 00000100:00100000:2.0:1788530516.849456:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941888 00000100:00100000:2.0:1788530516.849473:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941504 00000100:00100000:2.0:1788530516.849475:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941504 00000100:00100000:2.0:1788530516.849489:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788530516.849498:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+30:3647:x1875409555941376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.849509:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530516.849522:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125751693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575168c expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849533:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530516.849588:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555941376:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530516.849594:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788530516.849609:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530516.849614:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3647:x1875409555941888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.849621:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530516.849628:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20ca00/0xb28d70e125751677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751670 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849642:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530516.849664:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:3647:x1875409555941888:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530516.849670:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530516.849718:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788530516.849725:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:3647:x1875409555941504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.849732:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530516.849740:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125751b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751b0f expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849749:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530516.849770:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:3647:x1875409555941504:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530516.849775:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788530516.849804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555941632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.849827:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.849850:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530516.849855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555941760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.849874:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.849897:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941632 00000100:00100000:2.0:1788530516.849901:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941632 00000100:00100000:2.0:1788530516.849924:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555941760 00000100:00100000:2.0:1788530516.849926:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555941760 00000100:00100000:2.0:1788530516.849944:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530516.849950:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:3649:x1875409555941632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.849958:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530516.849973:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125751cb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751cac expref: 26 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.849981:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530516.850009:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:3649:x1875409555941632:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530516.850015:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530516.850026:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530516.850033:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3649:x1875409555941760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.850040:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530516.850047:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20d200/0xb28d70e125751685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575167e expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530516.850054:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530516.850075:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:3649:x1875409555941760:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530516.850080:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530516.850111:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555941760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.850119:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555941632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.850152:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.850159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530516.850166:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555941888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530516.850209:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530516.850403:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788530516.851465:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0aae9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788530516.851677:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f0aaef000 for lustre-MDT0000 00000020:00080000:0.0:1788530516.852691:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9e0223a800), last request at 1788530515 00000020:00000080:0.0:1788530516.852710:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751933 00000100:00080000:0.0:1788530516.852722:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788530516.855523:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788530516.855555:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e0223a800): rc 0 00000020:00000080:2.0:1788530516.855629:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e0223a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788530516.858861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01b10000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788530516.858947:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e01b13000 for lustre-MDT0000 00000020:00000080:1.0:1788530516.860377:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0223a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788530516.860441:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0223b800 for lustre-MDT0000 00000020:00080000:2.0:1788530516.860777:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9e027aa000), last request at 1788530425 00000020:00000080:2.0:1788530516.860788:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751868 00000100:00080000:2.0:1788530516.860797:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788530516.860822:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e027aa000): rc 0 00000020:00000080:2.0:1788530516.860825:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e027aa000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788530516.860841:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9f3288b000), last request at 1788530425 00000020:00000080:2.0:1788530516.860845:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517ff 00000100:00080000:2.0:1788530516.860849:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ceb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530516.860934:0:20750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:2.0:1788530516.861049:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f3288b000): rc 0 00000004:00000080:2.0:1788530516.861056:0:20750:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb37801483ae0 00000100:00080000:2.0:1788530516.861081:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788530516.861086:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:3.0:1788530516.862409:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027aa000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788530516.862481:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027a9800 for lustre-MDT0000 00000100:00080000:2.0:1788530516.862710:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788530516.862746:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788530516.863002:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942016:0@lo:39:umount.0 00000100:00100000:3.0:1788530516.863074:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530516.863591:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942016 00000100:00100000:2.0:1788530516.863601:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942016 00000100:00100000:2.0:1788530516.863661:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788530516.863671:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555942016:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788530516.863711:0:17163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751892 00000100:00080000:2.0:1788530516.863720:0:17163:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788530516.863778:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530516.866031:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530516.866290:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788530516.866296:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788530516.866324:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788530516.866388:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788530516.866418:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788530516.866452:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788530516.866455:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788530516.866465:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788530516.866535:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788530516.866585:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788530516.866631:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a9f3d210000) has no exports 00000100:00100000:1.0:1788530516.866952:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942144:0@lo:9:umount.0 00000100:00100000:1.0:1788530516.867036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530516.867084:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942144 00000100:00100000:1.0:1788530516.867092:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942144 00000100:00100000:1.0:1788530516.867145:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788530516.867155:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555942144:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530516.867183:0:18666:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751987 00000100:00080000:1.0:1788530516.867194:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530516.867243:0:18666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788530516.867641:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875409555942144:12345-0@lo:9:umount.0 Request processed in 485us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530516.867650:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788530516.867676:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530516.867718:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530516.867969:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000001:00000004:2.0:1788530516.868329:0:17163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1788530516.868521:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530516.868708:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1875409555942016:12345-0@lo:39:umount.0 Request processed in 5027us (5622us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788530516.868719:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000004:00080000:1.0:1788530516.874200:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530516.874219:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942144:0@lo:9:umount.0 00000100:00100000:1.0:1788530516.874253:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942272:0@lo:9:umount.0 00000100:00100000:1.0:1788530516.874383:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530516.874725:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942272 00000100:00100000:1.0:1788530516.874737:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942272 00000100:00100000:1.0:1788530516.874799:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788530516.874810:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555942272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530516.874852:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751b1d 00000100:00080000:1.0:1788530516.874863:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f274fd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530516.874917:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788530516.875294:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1875409555942272:12345-0@lo:9:umount.0 Request processed in 484us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530516.875379:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788530516.875522:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530516.875683:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788530516.886600:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530516.886617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942272:0@lo:9:umount.0 00000100:00080000:1.0:1788530516.886668:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788530516.886675:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555942016:0@lo:39:umount.0 00010000:00010000:1.0:1788530516.886738:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788530516.924536:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a9f3d210000) has no exports 00000020:00000080:3.0:1788530516.992589:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516d9 00000020:00000080:3.0:1788530516.992607:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e03d6a800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788530516.992691:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788530516.992773:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530516.992785:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788530516.992816:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a9e027b9988) has no exports 00000020:00000080:2.0:1788530516.993119:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516d2 00000020:00000080:2.0:1788530516.993125:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f0a17d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788530516.994597:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03d6a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788530516.996085:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0a17d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788530516.996724:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530516.996737:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788530516.996742:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f3d0c7800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788530516.996746:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d0c7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788530516.996756:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1788530517.056973:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530517.056996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555942400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530517.057069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530517.057178:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942400 00000100:00100000:2.0:1788530517.057190:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942400 00000100:00100000:2.0:1788530517.057279:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530517.057297:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555942400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530517.057335:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530517.057388:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555942400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530517.057395:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788530517.057593:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530517.057630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555942400:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788530517.057862:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530517.569131:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555942528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530517.569217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530517.569424:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942528 00000100:00100000:0.0:1788530517.569434:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942528 00000100:00100000:0.0:1788530517.569486:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530517.569496:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875409555942528:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788530517.569504:0:17899:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788530517.569555:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875409555942528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (338us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788530517.569588:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:02020000:2.0:1788530517.569667:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788530517.575623:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788530517.575633:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788530517.575638:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788530517.591548:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530517.591579:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1788530517.591590:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f396b3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530517.591631:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37367480 x1875409555942656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530517.592130:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555942656:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788530517.592200:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530517.592810:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942656 00000100:00100000:2.0:1788530517.592819:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942656 00000100:00100000:2.0:1788530517.592867:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530517.592875:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555942656:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788530517.592903:0:17163:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788530517.597431:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555942656:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4547us (5222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530517.597446:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788530517.597675:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530517.597681:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788530517.597686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555942656:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788530518.082865:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788530518.083249:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788530518.083384:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788530518.083392:0:17891:0:(genops.c:885:class_export_put()) final put ffff9a9e027ae800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788530518.083548:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00080000:0.0:1788530518.083553:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788530518.083556:0:17891:0:(genops.c:885:class_export_put()) final put ffff9a9f3b054800/5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:0.0:1788530518.083583:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:00080000:0.0:1788530518.083588:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788530518.083590:0:17891:0:(genops.c:885:class_export_put()) final put ffff9a9e026c2000/66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:1.0:1788530518.083797:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027ae800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788530518.083865:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3b054800/5fa0991a-e80a-4f33-96cf-7430c54598af for lustre-MDT0001 00000020:00000080:1.0:1788530518.083890:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e026c2000/66d42348-56b8-4977-9cd3-df6ed37388a6 for lustre-MDT0001 00000020:00000080:1.0:1788530518.083914:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f0d6f0000 for lustre-MDT0001 00000020:00000080:1.0:1788530518.083920:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3b054000 for lustre-MDT0001 00000020:00000080:1.0:1788530518.083923:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e026c6800 for lustre-MDT0001 00000001:00100000:1.0:1788530518.084894:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788530518.084899:0:19495:0:(genops.c:885:class_export_put()) final put ffff9a9f274fe000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788530518.084922:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:1.0:1788530518.084924:0:19495:0:(genops.c:885:class_export_put()) final put ffff9a9f047ff000/66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:3.0:1788530518.084979:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788530518.085020:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047ff000/66d42348-56b8-4977-9cd3-df6ed37388a6 for lustre-OST0001 00000020:00000080:3.0:1788530518.085036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f274fd000 for lustre-OST0001 00000020:00000080:3.0:1788530518.085040:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f047f8000 for lustre-OST0001 00000001:00100000:2.0:1788530518.085245:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788530518.085249:0:17139:0:(genops.c:885:class_export_put()) final put ffff9a9f3288b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530518.085430:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3288b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788530518.085468:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f08ceb000 for lustre-MDT0000 00000001:00100000:2.0:1788530518.085842:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00080000:2.0:1788530518.085851:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1788530518.085854:0:17139:0:(genops.c:885:class_export_put()) final put ffff9a9f274fa800/5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:2.0:1788530518.085872:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:00080000:2.0:1788530518.085877:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1788530518.085879:0:17139:0:(genops.c:885:class_export_put()) final put ffff9a9e01b17000/66d42348-56b8-4977-9cd3-df6ed37388a6 00000020:00000080:3.0:1788530518.085924:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274fa800/5fa0991a-e80a-4f33-96cf-7430c54598af for lustre-MDT0000 00000020:00000080:3.0:1788530518.085972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01b17000/66d42348-56b8-4977-9cd3-df6ed37388a6 for lustre-MDT0000 00000020:00000080:3.0:1788530518.085999:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f274ff000 for lustre-MDT0000 00000020:00000080:3.0:1788530518.086004:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e01b11000 for lustre-MDT0000 00000040:00080000:1.0:1788530518.657448:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1788530519.040962:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f17cd9f60 - data ffff9a9f2bd35870/ffff9a9e026cf800 00000020:01000000:0.0:1788530519.041154:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e03c0c780 - data ffff9a9f2bea9948/ffff9a9f34127800 00000001:00000004:0.0:1788530519.053614:0:20750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:3.0:1788530519.104990:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530519.122239:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530519.122248:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788530519.122263:0:20750:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a9f37367800 x1875409555942016/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788530526 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530519.122289:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788530519.124071:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530519.124079:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788530519.124102:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530519.124104:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788530519.124937:0:17182:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788530519.124945:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788530519.124982:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788530519.126981:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530519.126992:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788530519.127047:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530519.127050:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788530519.128430:0:17184:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788530519.128437:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788530519.128449:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788530519.131216:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516a1 00000020:00000080:2.0:1788530519.131233:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f39686000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788530519.132189:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f39686000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788530519.134218:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516b6 00000020:00000080:2.0:1788530519.134234:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f08ce2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530519.134253:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788530519.134258:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530519.134384:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788530519.134389:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a9f3d213310) has no exports 00000004:01000000:2.0:1788530519.134554:0:20750:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788530519.134628:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08ce2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788530519.134810:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751718 00000020:00000080:2.0:1788530519.134833:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f37411000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530519.134850:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788530519.134854:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530519.134860:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530519.134863:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a9e027bcc98) has no exports 00000020:00000080:2.0:1788530519.134871:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751711 00000020:00000080:2.0:1788530519.134876:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f37416800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788530519.135259:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f37411000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788530519.135279:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f37416800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788530519.137993:0:20750:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788530519.138003:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530519.138009:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788530519.138018:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530519.138020:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530519.138115:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530519.138126:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788530519.138135:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751703 00000020:00000080:2.0:1788530519.138145:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f37413000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788530519.140396:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f37411800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788530519.140424:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f37414800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788530519.140429:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f37414800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788530519.140443:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788530519.141048:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788530519.141058:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530519.141068:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530519.141073:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a9f33d90000) has no exports 00000020:00000080:2.0:1788530519.141081:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516fc 00000020:00000080:2.0:1788530519.141088:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e024de000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788530519.143231:0:20750:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788530519.143243:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530519.143249:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788530519.143259:0:20750:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530519.143261:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530519.144635:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530519.144663:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788530519.144771:0:20750:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788530519.144782:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516ee 00000020:00000080:2.0:1788530519.144792:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e03d6b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530519.144820:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788530519.144826:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530519.144832:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530519.144836:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9a9e027bb310) has no exports 00000020:00000080:2.0:1788530519.144846:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516e7 00000020:00000080:2.0:1788530519.144851:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f39680800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788530519.145871:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f37413000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788530519.145889:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e024de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788530519.145909:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e024dd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788530519.145916:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9e03d6a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788530519.145919:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03d6a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788530519.145923:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788530519.146024:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03d6b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788530519.146032:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f39680800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788530519.181517:0:20750:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788530519.181543:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530519.181547:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788530519.181555:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788530519.181660:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530519.181674:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530519.181714:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530519.181719:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530519.181724:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f39685800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530519.181729:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f39685800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788530519.181742:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530519.181855:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516bd 00000020:00000080:3.0:1788530519.181861:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f08ce3800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788530519.181866:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788530519.181870:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530519.181875:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788530519.181879:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a9f3d211988) has no exports 00000020:00000080:3.0:1788530519.181897:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530519.181900:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788530519.181903:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257516c4 00000020:00000080:3.0:1788530519.181907:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f08ce6000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788530519.181915:0:20750:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f202a8800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788530519.181918:0:20750:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f202a8800 3 00000020:01000004:3.0:1788530519.181921:0:20750:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f202a8800 from lustre-MDT0000 00000020:00000080:3.0:1788530519.181937:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530519.181940:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788530519.181942:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f39685000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788530519.181944:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f39685000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788530519.181950:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788530519.181982:0:20750:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788530519.181985:0:20750:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788530519.181987:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788530519.181990:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530519.181998:0:20750:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530519.182005:0:20750:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a9e0441c000 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 0@lo 22 (0 0 17) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530519.182009:0:20750:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a9f33d93310) has exports, disconnecting them 00000020:00080000:3.0:1788530519.182013:0:20750:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a9e0441c000), last request at 1788530406 00000020:00000080:3.0:1788530519.182026:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751669 00000020:00010000:3.0:1788530519.182030:0:20750:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9e0441c000: total 2 00000100:00080000:3.0:1788530519.182033:0:20750:0:(import.c:65:import_set_state_nolock()) ffff9a9e0441d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788530519.182043:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e0441c000): rc 0 00000020:00080000:3.0:1788530519.182046:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a9f33d93310) has no exports 00000100:00100000:3.0:1788530519.182095:0:17154:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a9e02237800:17154] 2 exiting: rc = 0 00000100:00100000:3.0:1788530519.182203:0:17151:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a9f396d8800:17151] 0 exiting: rc = 1 00000020:00010000:1.0:1788530519.182700:0:18991:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9e0441c000: total 2 00010000:00010000:1.0:1788530519.182758:0:18991:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9e0441c000, canceled 0 locks, left on hash table 17. 00010000:00010000:1.0:1788530519.182798:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20cc00/0xb28d70e1257518e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257518df expref: 18 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182818:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101400/0xb28d70e125751788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751781 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182831:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a600/0xb28d70e125751a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751a6e expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182842:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20c000/0xb28d70e125751796 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575178f expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182859:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20dc00/0xb28d70e1257517a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575179d expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182871:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257517b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257517ab expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182882:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012ebe00/0xb28d70e125751853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575184c expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182894:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751c90 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182932:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d400/0xb28d70e125751afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751af3 expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182945:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100000/0xb28d70e12575191e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751917 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182956:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751c82 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182965:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012ea200/0xb28d70e125751aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751aa6 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182978:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e125751aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751ae5 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182989:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eba00/0xb28d70e125751a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751a60 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.182998:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a000/0xb28d70e125751ca5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751c9e expref: 4 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.183009:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d200/0xb28d70e125751b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125751b01 expref: 3 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.183020:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eac00/0xb28d70e1257518d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257518d1 expref: 2 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530519.183031:0:18991:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9e0441c000, canceled 17 locks, left on hash table 0. 00000020:00000080:1.0:1788530519.183047:0:18991:0:(genops.c:885:class_export_put()) final put ffff9a9e0441c000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 00010000:00010000:1.0:1788530519.183057:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530519.183065:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530519.183068:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530519.183106:0:17153:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a9e02236600:17153] 1 exiting: rc = 0 00000020:00000080:1.0:1788530519.183172:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0258b800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788530519.183179:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9e03d6d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788530519.183182:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03d6d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788530519.183186:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788530519.183230:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08ce3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788530519.183234:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f08ce0800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788530519.183235:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08ce0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788530519.183239:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788530519.183262:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08ce6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788530519.183267:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0441c000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 for MGS 00000020:00000080:1.0:1788530519.183292:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0441d000 for MGS 00000100:00100000:3.0:1788530519.184749:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184762:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184768:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184773:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184780:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184788:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184796:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184802:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184809:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184815:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184820:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184824:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184829:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184835:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184841:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184847:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184853:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184858:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184863:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184869:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184875:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184880:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184898:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184904:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184909:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184914:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184920:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184926:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184932:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184938:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184944:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184949:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184955:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184962:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184968:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184975:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184981:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184988:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.184995:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185001:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185008:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185014:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185020:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185027:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185033:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185038:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185044:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185049:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185055:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185061:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185067:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185072:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185079:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185086:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185092:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185098:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185104:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185118:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185123:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185130:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185136:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185142:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185147:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530519.185153:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788530519.189657:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f17cd9720 - data ffff9a9f2bc79870/ffff9a9e026cd400 00000020:01000000:3.0:1788530519.189855:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f3738fde0 - data ffff9a9f2bc17360/ffff9a9f01386c00 00000020:00000080:3.0:1788530519.190763:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575164d 00000020:00000080:3.0:1788530519.190776:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f202ad800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788530519.190798:0:20750:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f202a8800 from MGS, refs=2 00000020:01000004:3.0:1788530519.190802:0:20750:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f202a8800 2 00000020:01000004:3.0:1788530519.190806:0:20750:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f202a8800 from MGS 00000020:00000080:3.0:1788530519.190836:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530519.190845:0:20750:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788530519.190848:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95c800/MGS 00000020:00000080:3.0:1788530519.190851:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95c800/MGS for MGS 00000020:01000000:3.0:1788530519.190858:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788530519.190931:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788530519.190935:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530519.190941:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530519.190948:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a9f08ce5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530519.190954:0:20750:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a9f2c14cc98) has exports, disconnecting them 00000020:00080000:3.0:1788530519.190960:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a9f08ce5800), last request at 1788530406 00000020:00000080:3.0:1788530519.190964:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751750 00000020:00080000:3.0:1788530519.190978:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f08ce5800): rc 0 00000020:00000080:3.0:1788530519.190983:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f08ce5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788530519.192127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f202ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788530519.192149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08ce5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788530519.279705:0:20750:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788530519.279714:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530519.279719:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788530519.279727:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788530519.279763:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e03636000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788530519.279924:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530519.279933:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788530519.279939:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9e03637000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788530519.279944:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03637000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788530519.279951:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788530519.280064:0:20750:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f202a8800 1 00000020:00000080:1.0:1788530519.280073:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575163f 00000020:00000080:1.0:1788530519.280092:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95e000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788530519.280100:0:20750:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788530519.280108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788530519.280119:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530519.280124:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530519.280128:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a9f33d94c98) has no exports 00000020:00000080:1.0:1788530519.548783:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530519.548798:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788530519.548805:0:20750:0:(genops.c:885:class_export_put()) final put ffff9a9f2b959800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788530519.548810:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b959800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788530519.548825:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788530519.548958:0:20750:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9f2b95d000 00000020:02000400:1.0:1788530519.549025:0:20750:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1788530520.130211:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530520.130221:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788530520.130226:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530520.130236:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 725 00000100:00080000:2.0:1788530520.130246:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530520.130255:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f396b3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530520.130284:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37365f80 x1875409555942912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530520.130457:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555942784:0@lo:400:kworker.0 00000400:00000100:1.0:1788530520.130512:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555942784 offset 0 length 224: 4 00000100:00100000:1.0:1788530520.130551:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555943424:0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.130611:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530520.130633:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555943936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530520.130683:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530520.130710:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788530520.130716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555943296:0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.130739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530520.130757:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555943808:0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.130778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530520.130812:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943424 00000100:00100000:1.0:1788530520.130819:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943424 00000100:00100000:1.0:1788530520.130858:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943296 00000100:00100000:1.0:1788530520.130861:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943296 00000100:00100000:1.0:1788530520.130893:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943808 00000100:00100000:1.0:1788530520.130897:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943808 00000100:00100000:1.0:1788530520.130928:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530520.130939:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555943808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.130991:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555943808:12345-0@lo:400:kworker.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530520.130998:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530520.131016:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788530520.131020:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875409555943424:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788530520.131026:0:19968:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788530520.131050:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875409555943424:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788530520.131055:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788530520.131064:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788530520.131068:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875409555943296:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788530520.131072:0:19968:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788530520.131090:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875409555943296:12345-0@lo:400:kworker.0 Request processed in 21us (351us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788530520.131096:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788530520.131112:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943936 00000100:00100000:1.0:1788530520.131115:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943936 00000100:00100000:1.0:1788530520.131138:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788530520.131144:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555943936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530520.131168:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530520.131198:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555943936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530520.131204:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788530520.131238:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530520.131242:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530520.131270:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788530520.131275:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788530520.131279:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788530520.131284:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530520.131287:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788530520.131291:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a9e027ac000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530520.131309:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375c380 x1875409555944064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530520.131322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555943296:0@lo:400:kworker.0 00010000:00080000:1.0:1788530520.131335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd2d80 x1875409555943808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530520.131345:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555943808:0@lo:400:kworker.0 00000100:00080000:1.0:1788530520.131354:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788530520.131356:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788530520.131360:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788530520.131362:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530520.131365:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1788530520.131369:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e025eb800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530520.131381:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375e300 x1875409555944192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530520.131390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555943424:0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.131417:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555943936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530520.135501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555943040:0@lo:400:kworker.0 00000100:00100000:3.0:1788530520.135599:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135646:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555943552:0@lo:400:kworker.0 00000100:00100000:3.0:1788530520.135710:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135738:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788530520.135746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555943168:0@lo:400:kworker.0 00000100:00100000:3.0:1788530520.135768:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135785:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555943680:0@lo:400:kworker.0 00000100:00100000:3.0:1788530520.135807:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135832:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555942912:0@lo:38:kworker.0 00000100:00100000:3.0:1788530520.135858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135876:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555944064:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788530520.135897:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.135913:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555944192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788530520.135932:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530520.136203:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555942912 00000100:00100000:3.0:1788530520.136212:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555942912 00000100:00100000:3.0:1788530520.136252:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530520.136260:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555942912:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788530520.136283:0:17164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530520.138116:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943040 00000100:00100000:1.0:1788530520.138131:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943040 00000100:00100000:1.0:1788530520.138199:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943168 00000100:00100000:1.0:1788530520.138203:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943168 00000100:00100000:1.0:1788530520.138231:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788530520.138242:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555943040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.138324:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555943040:12345-0@lo:400:kworker.0 Request processed in 83us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530520.138331:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788530520.138362:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788530520.138369:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.138400:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555943168:12345-0@lo:400:kworker.0 Request processed in 31us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530520.138405:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788530520.138435:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943552 00000100:00100000:1.0:1788530520.138438:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943552 00000100:00100000:1.0:1788530520.138466:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555943680 00000100:00100000:1.0:1788530520.138469:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555943680 00000100:00100000:1.0:1788530520.138477:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555944064 00000100:00100000:1.0:1788530520.138479:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555944064 00000100:00100000:1.0:1788530520.138485:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555944192 00000100:00100000:1.0:1788530520.138488:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555944192 00000100:00100000:1.0:1788530520.138495:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530520.138501:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555943552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.138529:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555943552:12345-0@lo:400:kworker.0 Request processed in 29us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530520.138553:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530520.138599:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530520.138604:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875409555943680:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788530520.138610:0:17160:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788530520.138635:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875409555943680:12345-0@lo:400:kworker.0 Request processed in 30us (2827us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788530520.138640:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530520.138649:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788530520.138653:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944064:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788530520.140228:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530520.140304:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944064:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1648us (4404us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530520.140314:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788530520.140338:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530520.140344:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944192:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788530520.140353:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530520.140376:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944192:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32us (4443us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530520.140382:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788530520.140409:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530520.140415:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530520.140456:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555943168:0@lo:400:kworker.0 00000100:00080000:1.0:1788530520.140470:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788530520.140474:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788530520.140489:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788530520.140493:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530520.140497:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 671 00000100:00080000:1.0:1788530520.140506:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e01b16800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530520.140535:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375e680 x1875409555944320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530520.140551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555943680:0@lo:400:kworker.0 00000100:00100000:1.0:1788530520.140588:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555943040:0@lo:400:kworker.0 00010000:00080000:1.0:1788530520.140600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37367480 x1875409555943552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530520.140609:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555943552:0@lo:400:kworker.0 00000100:00100000:2.0:1788530520.142858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555944320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788530520.142947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788530520.142999:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530520.143004:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530520.143008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555944064:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788530520.143019:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530520.143022:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530520.143026:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555944192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788530520.143256:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555944320 00000100:00100000:1.0:1788530520.143264:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555944320 00000100:00100000:1.0:1788530520.143311:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788530520.143319:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788530520.143338:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530520.143382:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555944320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 63us (435us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530520.143389:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:0.0:1788530520.143534:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530520.143803:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530520.143809:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530520.143813:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555944320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788530520.170555:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555942912:12345-0@lo:38:kworker.0 Request processed in 34284us (34686us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788530520.170644:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530520.170652:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530520.170758:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555942912:0@lo:38:kworker.0 00000100:00100000:3.0:1788530520.174833:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:1.0:1788530521.153828:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530522.176958:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555944448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530522.177061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530522.177294:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555944448 00000100:00100000:0.0:1788530522.177302:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555944448 00000100:00100000:0.0:1788530522.177377:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530522.177389:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555944448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530522.177418:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530522.177471:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555944448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530522.177478:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530522.177525:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555944448:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788530522.178021:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788530522.184236:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530523.201503:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788530523.203486:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788530523.203495:0:18663:0:(genops.c:885:class_export_put()) final put ffff9a9f33b6d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788530523.203557:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b6d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788530523.210141:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f33b6f000 for lustre-OST0000 00000020:01000004:1.0:1788530523.665222:0:20952:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788530523.690202:0:20952:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788530523.690279:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.690295:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.690303:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.690311:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.690455:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530523.690482:0:20952:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 10000000:01000000:2.0:1788530523.690488:0:20952:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788530523.690514:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530523.690521:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788530523.690528:0:20952:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788530523.690533:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788530523.690539:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530523.690540:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788530523.690543:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788530523.691475:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530523.691485:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530523.691495:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530523.691500:0:17148:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530523.691528:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530523.691536:0:17148:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530523.691543:0:17148:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788530523.691545:0:17148:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788530523.691548:0:17148:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788530523.692067:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530523.692077:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788530523.692154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555944576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530523.692250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530523.693461:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530523.693477:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530523.693494:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530523.693496:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530523.693499:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530523.693544:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555944576 00000100:00100000:3.0:1788530523.693554:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555944576 00000100:00100000:3.0:1788530523.693619:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530523.693627:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875409555944576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788530523.693634:0:20204:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530523 with bad export cookie 12866063822765758057 00010000:00010000:2.0:1788530523.695287:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.695305:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699016:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699026:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699067:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530523.699090:0:20952:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-MDT0001 00010000:00010000:2.0:1788530523.699100:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699109:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699116:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699122:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699141:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530523.699148:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699155:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699161:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699178:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699195:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788530523.699204:0:20952:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 00010000:00010000:2.0:1788530523.699210:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699217:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699224:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699231:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699238:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788530523.699243:0:20952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699249:0:20952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699254:0:20952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699260:0:20952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530523.699275:0:20952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788530523.699611:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788530523.699620:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699628:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530523.699633:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699654:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530523.699661:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530523.699666:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530523.699669:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-MDT0001: stale lock, won't requeue 00010000:00010000:1.0:1788530523.699710:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699717:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530523.699742:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699750:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699765:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788530523.699769:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699775:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530523.699787:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699795:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530523.699802:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530523.699807:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530523.699809:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788530523.699812:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788530523.699910:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699917:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530523.699924:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699930:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699939:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530523.699942:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699947:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530523.699950:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.699956:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530523.699969:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530523.699975:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788530523.699977:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788530523.699979:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788530523.700010:0:18991:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.700016:0:18991:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1788530523.703572:0:20952:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788530523.703583:0:20952:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788530523.703628:0:20952:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788530523.703680:0:20952:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788530523.703684:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788530523.703689:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530523.703695:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788530523.703704:0:20952:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a9e01b12000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530523.703711:0:20952:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a9f274da000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530523.703715:0:20952:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a9f2c14e620) has exports, disconnecting them 00000020:00080000:2.0:1788530523.703721:0:20952:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a9e01b12000), last request at 1788530520 00000020:00000080:2.0:1788530523.703729:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751ad7 00000100:00080000:2.0:1788530523.703759:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b14800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788530523.703837:0:20952:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e01b12000): rc 0 00000020:00000080:2.0:1788530523.703840:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9e01b12000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788530523.703861:0:20952:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a9f274da000), last request at 1788530520 00000020:00000080:2.0:1788530523.703864:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751948 00000100:00080000:2.0:1788530523.703871:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9f274df000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788530523.703877:0:20952:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f274da000): rc 0 00000020:00000080:2.0:1788530523.703879:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f274da000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788530523.703887:0:20952:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb37801be7ae0 00000100:00080000:2.0:1788530523.703913:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530523.703927:0:20952:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a9f33afd880 x1875409555942528/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788530533 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530523.703941:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788530523.704424:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530523.704434:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704446:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530523.704465:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704476:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530523.704484:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530523.704490:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530523.704493:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788530523.704496:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788530523.704583:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704592:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530523.704609:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704617:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704647:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530523.704652:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704659:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36be00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530523.704662:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704669:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530523.704683:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530523.704688:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530523.704691:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788530523.704693:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788530523.704722:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704729:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530523.704735:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704742:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530523.704752:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530523.704754:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530523.704756:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530523.704766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01b12000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788530523.704811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274da000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788530523.704831:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e01b14800 for lustre-MDT0001 00000020:00000080:0.0:1788530523.704836:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f274df000 for lustre-MDT0001 00000100:00100000:0.0:1788530523.704868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555945088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530523.704936:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530523.704977:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555945088 00000100:00100000:0.0:1788530523.704984:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555945088 00000100:00100000:0.0:1788530523.705021:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530523.705029:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875409555945088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788530523.705041:0:17144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530523 with bad export cookie 12866063822765758057 00000100:00100000:0.0:1788530523.705085:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875409555945088:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (149us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788530523.705092:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788530523.705140:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788530523.705144:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788530523.705148:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788530523.707509:0:20952:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788530523.707536:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788530523.712868:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.712888:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530523.712928:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530523.712931:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530523.712933:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530523.723064:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875409555944576:12345-0@lo:103:ldlm_bl.0 Request processed in 29431us (30808us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788530523.723095:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788530523.723143:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530523.746881:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.141@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788530523.746888:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788530523.746898:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f37364000 x1875409555942784/t0(0) o400->MGC192.168.202.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788530536 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530523.746915:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f33afea00 x1875409555944576/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530539 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530523.746926:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3960d500 x1875409555945088/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530539 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788530523.746935:0:3648:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788530523.746937:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788530523.746939:0:3648:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788530523.750698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:0:1875409555944704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530523.750713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:0:1875409555945216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530523.750720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555942528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530523.752064:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:0:1875409555944832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530523.752092:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555942784:0@lo:400:kworker.0 00000100:00080000:3.0:1788530523.752482:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788530523.752487:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788530523.752502:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788530523.752586:0:20952:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788530523.752615:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788530523.752648:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788530523.752650:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788530523.752667:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788530523.752724:0:20952:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788530523.752733:0:20952:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788530523.752774:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a9f2c14e620) has no exports 00000100:00100000:3.0:1788530523.752983:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555945344:0@lo:9:umount.0 00000100:00100000:3.0:1788530523.753049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530523.753080:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555945472:0@lo:9:umount.0 00000100:00100000:3.0:1788530523.753118:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530523.753296:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555945344 00000100:00100000:1.0:1788530523.753304:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555945344 00000100:00100000:1.0:1788530523.753345:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555945472 00000100:00100000:1.0:1788530523.753348:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555945472 00000100:00100000:1.0:1788530523.753376:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530523.753384:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875409555945344:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530523.753414:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751980 00000100:00080000:1.0:1788530523.753422:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f274b8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530523.753457:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788530523.753616:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1875409555945344:12345-0@lo:9:umount.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530523.753624:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530523.753653:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530523.753661:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875409555945472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530523.753672:0:18669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751b24 00000100:00080000:1.0:1788530523.753678:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f274f9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530523.753697:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788530523.753773:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1875409555945472:12345-0@lo:9:umount.0 Request processed in 113us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530523.753779:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788530523.753803:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788530523.753815:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530523.753842:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530523.753855:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788530523.753858:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530523.753861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555945344:0@lo:9:umount.0 00000100:00080000:1.0:1788530523.753873:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530523.753879:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788530523.753880:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530523.753883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555945472:0@lo:9:umount.0 00000100:00100000:2.0:1788530523.760810:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:0:1875409555944960:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788530523.763253:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530523.763268:0:3648:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1788530523.763278:0:3648:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9f3d0c4000 using connection 192.168.202.141@tcp/0@lo 00010000:00010000:0.0:1788530523.763333:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530523.763374:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960ce00 x1875409555945600/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530523.763436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555945600:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788530523.763501:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555945600 offset 0 length 520: 4 00000100:00100000:0.0:1788530523.763829:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555944576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530523.763853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555945088:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788530523.772785:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a9f2c14e620) has no exports 00000020:01000000:2.0:1788530523.838127:0:20952:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f3d1ccd80 - data ffff9a9f2bc43948/ffff9a9e0318ec00 00000020:01000000:2.0:1788530523.838339:0:20952:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f04dcc4e0 - data ffff9a9f2bda8d80/ffff9a9f0403b400 00000001:00000004:2.0:1788530523.847072:0:20952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788530523.929331:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530523.929345:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788530523.929353:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788530523.931333:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788530523.931341:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788530523.931361:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530523.931364:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788530523.931983:0:17900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788530523.931989:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788530523.932001:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788530523.932751:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788530523.932756:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788530523.932765:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530523.932767:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788530523.933120:0:17902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788530523.933125:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788530523.933133:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788530523.934074:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517c0 00000020:00000080:0.0:1788530523.934085:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f396b2800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788530523.935078:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517d5 00000020:00000080:0.0:1788530523.935089:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f04dd5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788530523.935096:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788530523.935101:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530523.935110:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788530523.935114:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a9f2c14b310) has no exports 00000004:01000000:0.0:1788530523.935271:0:20952:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788530523.935281:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751829 00000020:00000080:0.0:1788530523.935285:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f08cef000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788530523.935290:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788530523.935293:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530523.935299:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788530523.935302:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a9f33d91988) has no exports 00000020:00000080:0.0:1788530523.935308:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751822 00000020:00000080:0.0:1788530523.935311:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f0d6f2000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530523.936015:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f396b2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788530523.936042:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f04dd5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788530523.936046:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08cef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788530523.936051:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0d6f2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788530523.936146:0:20952:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788530523.936152:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788530523.936158:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788530523.936172:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530523.936174:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788530523.936346:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530523.936355:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788530523.936362:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751814 00000020:00000080:0.0:1788530523.936368:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f0d6f7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530523.939377:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f0d6f0800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788530523.939396:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f0d6f2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530523.939400:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0d6f2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788530523.939409:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788530523.940302:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788530523.940312:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530523.940333:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788530523.940338:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a9f3d216620) has no exports 00000020:00000080:0.0:1788530523.940346:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575180d 00000020:00000080:0.0:1788530523.940353:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f08cee800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788530523.940786:0:20952:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788530523.940790:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788530523.940794:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788530523.940799:0:20952:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530523.940802:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788530523.940833:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530523.940839:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788530523.940855:0:20952:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788530523.940861:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517f8 00000020:00000080:0.0:1788530523.940866:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f3288a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788530523.940871:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788530523.940875:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530523.940878:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788530523.940881:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a9f04531988) has no exports 00000020:00000080:0.0:1788530523.940884:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517f1 00000020:00000080:0.0:1788530523.940887:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f396b4800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530523.942225:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0d6f7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788530523.942242:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08cee800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788530523.942249:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f08ce8000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788530523.942258:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f08cea800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530523.942261:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f08cea800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788530523.942265:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530523.942364:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3288a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788530523.942370:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f396b4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788530523.942826:0:20952:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788530523.942831:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530523.942834:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788530523.942840:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788530523.942890:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530523.942908:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530523.942934:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530523.942938:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530523.942942:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f396b5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530523.942945:0:20952:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f396b5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788530523.942951:0:20952:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788530523.943109:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f396b3000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788530523.943131:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f3288c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788530523.943133:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3288c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788530523.943144:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530523.943670:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517dc 00000020:00000080:1.0:1788530523.943686:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f04dd0000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788530523.943702:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788530523.943706:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530523.943713:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788530523.943717:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a9f2c148000) has no exports 00000020:00000080:1.0:1788530523.943739:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530523.943743:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788530523.943748:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257517e3 00000020:00000080:1.0:1788530523.943751:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f04dd5000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788530523.943760:0:20952:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e03637800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788530523.943764:0:20952:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e03637800 2 00000020:01000004:1.0:1788530523.943767:0:20952:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9e03637800 from lustre-MDT0001 00000020:00000080:1.0:1788530523.943795:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530523.943799:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788530523.943803:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f396b6800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788530523.943806:0:20952:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f396b6800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788530523.943813:0:20952:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788530523.943848:0:20952:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788530523.943853:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788530523.943855:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530523.943859:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788530523.943866:0:20952:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a9e027a8800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788530523.943872:0:20952:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a9f32886620) has exports, disconnecting them 00000020:00080000:1.0:1788530523.943876:0:20952:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a9e027a8800), last request at 1788530425 00000020:00000080:1.0:1788530523.943880:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751861 00000020:00080000:1.0:1788530523.943892:0:20952:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e027a8800): rc 0 00000020:00000080:1.0:1788530523.943896:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9e027a8800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788530523.943990:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f04dd0000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788530523.943995:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f04dd3800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788530523.943997:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f04dd3800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788530523.944001:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788530523.944126:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f04dd5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788530523.945125:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027a8800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788530523.989370:0:20952:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788530523.989384:0:20952:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530523.989391:0:20952:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788530523.989401:0:20952:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788530523.989732:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027ac000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788530523.989868:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530523.989880:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788530523.989888:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9e027a8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788530523.989893:0:20952:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027a8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788530523.989905:0:20952:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788530523.990072:0:20952:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e03637800 1 00000020:00000080:1.0:1788530523.990080:0:20952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575177a 00000020:00000080:1.0:1788530523.990088:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f3d26b000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788530523.990132:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788530523.990137:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530523.990142:0:20952:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788530523.990146:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a9f2c149988) has no exports 00000020:00000080:3.0:1788530523.992963:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d26b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788530524.052198:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530524.052223:0:20952:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788530524.052231:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9e03631000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788530524.052236:0:20952:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03631000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788530524.052262:0:20952:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788530524.052413:0:20952:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9e03630000 00000020:01000000:0.0:1788530524.052437:0:20952:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788530524.052441:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530524.052446:0:20952:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788530524.052451:0:20952:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a9f33d96620) has no exports 00000100:00100000:2.0:1788530524.056462:0:18163:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a9f046aa400:18163] 3 exiting: rc = 0 00000100:00100000:2.0:1788530524.056661:0:17159:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a9f04d97600:17159] 1 exiting: rc = 0 00000100:00100000:0.0:1788530524.061945:0:19968:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a9f342cde00:19968] 4 exiting: rc = 0 00000100:00100000:0.0:1788530524.062135:0:17158:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a9f04d96000:17158] 0 exiting: rc = 1 00000100:00100000:0.0:1788530524.063053:0:17160:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a9e0327ac00:17160] 2 exiting: rc = 0 00000100:00100000:2.0:1788530524.063279:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063290:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063299:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063307:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063313:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063319:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063324:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063329:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063335:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063341:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063347:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063352:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063358:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063364:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063371:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063377:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063383:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063389:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063396:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063402:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063407:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063413:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063419:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063425:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063431:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063467:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063474:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063481:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063489:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063498:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063504:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063511:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063517:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063521:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063527:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063532:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063538:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063545:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063552:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063579:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063586:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063593:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063598:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063605:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063610:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063615:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063620:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063626:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063664:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063671:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063677:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063683:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063690:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063695:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063700:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063707:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063712:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063718:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063724:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063730:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063744:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063750:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063756:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.063761:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530524.066609:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a9f177b4e00:17162] 1 exiting: rc = 0 00000100:00100000:3.0:1788530524.071061:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a9f177b5000:17161] 0 exiting: rc = 1 00000100:00100000:2.0:1788530524.071255:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071266:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071273:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071282:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071289:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071295:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071303:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071311:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071317:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071325:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071332:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071338:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071344:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071349:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071355:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071362:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071369:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071375:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071381:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071387:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071394:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071400:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071406:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071412:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071417:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071422:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071428:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071433:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071438:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071444:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071450:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071469:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071475:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071480:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071486:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071491:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071496:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071502:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071508:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071513:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071519:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071524:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071530:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071535:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071541:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071547:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071553:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071579:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071586:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071592:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071596:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071602:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071606:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071611:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071616:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071620:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071625:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071643:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071651:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071656:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071661:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071666:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071671:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.071676:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530524.073827:0:17899:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a9f3d0c8200:17899] 2 exiting: rc = 0 00000100:00100000:2.0:1788530524.074101:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a9f32bd5c00:17163] 0 exiting: rc = 1 00000100:00100000:3.0:1788530524.074288:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a9f32bd4e00:17164] 1 exiting: rc = 0 00000100:00100000:2.0:1788530524.074552:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074703:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074710:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074725:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074732:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074738:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074745:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074752:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074758:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074763:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074769:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074774:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074780:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074786:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074792:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074813:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074819:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074824:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074832:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074838:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074843:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074849:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074855:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074860:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074866:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074872:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074879:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074910:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074919:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074925:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074931:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074937:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074944:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074950:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074955:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074962:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074978:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074985:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.074992:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075015:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075024:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075031:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075039:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075045:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075051:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075057:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075064:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075070:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075075:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075081:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075087:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075109:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075117:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075123:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075129:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075136:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075142:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075147:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075154:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075160:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075165:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075171:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075177:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.075192:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530524.085299:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a9f32bd4600:17165] 0 exiting: rc = 1 00000100:00100000:2.0:1788530524.085669:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a9f32bd5800:17166] 1 exiting: rc = 0 00000100:00100000:3.0:1788530524.085781:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085788:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085794:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085800:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085806:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085811:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085817:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085821:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085826:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085832:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085837:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085856:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085863:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085868:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085874:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085879:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085892:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085904:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085926:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085938:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085943:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085947:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085952:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085965:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085970:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085976:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085981:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085986:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.085997:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086002:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086006:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086011:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086021:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086027:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086032:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086038:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086043:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086047:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086060:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086066:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086071:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086076:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086089:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086094:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086099:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086110:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086116:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086121:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086127:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086138:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086144:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086148:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086154:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086173:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086178:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086190:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086195:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086199:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086204:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086214:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086218:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086223:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086227:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530524.086232:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.086704:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a9f32bd4800:17167] 0 exiting: rc = 1 00000100:00100000:1.0:1788530524.090942:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a9f0ce13600:17168] 1 exiting: rc = 0 00000100:00100000:2.0:1788530524.091200:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091209:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091214:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091225:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091231:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091259:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091264:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091269:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091274:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091286:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091293:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091299:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091304:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091315:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091323:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091329:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091340:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091346:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091352:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091364:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091371:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091376:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091382:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091394:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091400:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091405:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091411:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091424:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091429:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091434:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091439:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091451:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091457:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091467:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091483:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091488:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091492:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091498:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091510:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091514:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091533:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091540:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091546:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091551:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091809:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091819:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091824:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091834:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091841:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091846:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091851:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091862:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091867:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091872:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091883:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091889:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091895:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091915:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091920:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091926:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091937:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091943:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091948:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.091954:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530524.093339:0:17170:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a9f01380c00:17170] 1 exiting: rc = 0 00000100:00100000:0.0:1788530524.094067:0:17169:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a9f01381600:17169] 0 exiting: rc = 1 00000100:00100000:2.0:1788530524.094308:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094316:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094322:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094327:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094332:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094338:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094344:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094349:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094354:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094360:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094365:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094382:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094388:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094393:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094398:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094403:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094408:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094413:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094418:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094423:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094428:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094434:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094438:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094444:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094449:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094454:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094459:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094464:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094470:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094474:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094478:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094483:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094487:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094492:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094496:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094502:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094507:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094511:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094516:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094521:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094525:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094530:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094536:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094542:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094548:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094553:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094816:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094822:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094827:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094832:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094837:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094842:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094848:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094853:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094859:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094864:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094869:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094875:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094880:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094885:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094890:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094894:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094973:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.094980:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.095980:0:17171:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a9f3d105c00:17171] 0 exiting: rc = 1 00000100:00100000:1.0:1788530524.096257:0:17172:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a9f33b65600:17172] 1 exiting: rc = 0 00000100:00100000:0.0:1788530524.096551:0:17173:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a9f177b4200:17173] 2 exiting: rc = 0 00000100:00100000:2.0:1788530524.096741:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096749:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096755:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096762:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096768:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096782:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096790:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096796:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096802:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096808:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096813:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096819:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096825:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096830:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096836:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096842:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096859:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096866:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096871:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096878:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096884:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096892:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.096990:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097000:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097005:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097012:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097019:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097026:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097033:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097039:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097048:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097054:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097060:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097066:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097072:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097078:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097083:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097090:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097096:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097101:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097107:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097113:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097119:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097125:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097131:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097137:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097158:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097165:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097170:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097176:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097181:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097195:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097200:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097206:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097212:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097217:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097222:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097228:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097233:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097238:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097244:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097249:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097254:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530524.097268:0:20952:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788530524.103265:0:20952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530524.103284:0:20952:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788530524.103293:0:20952:0:(genops.c:885:class_export_put()) final put ffff9a9f2b958000/MDS_uuid 00000020:00000080:2.0:1788530524.103298:0:20952:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b958000/MDS_uuid for MDS 00000020:01000000:2.0:1788530524.103306:0:20952:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788530524.103528:0:20952:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788530524.224800:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530525.263747:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530525.264197:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530525.264203:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530525.264206:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530525.264210:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788530525.264214:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530525.264223:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 728 00000100:00080000:3.0:1788530525.264229:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788530525.264235:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e025eb800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530525.264298:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df93100 x1875409555945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530525.264368:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530525.264372:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788530525.264374:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530525.264378:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 728 00000100:00080000:3.0:1788530525.264380:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788530525.264385:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e01b16800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530525.264413:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df91180 x1875409555945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530525.264464:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555945856:0@lo:400:kworker.0 00000400:00000100:3.0:1788530525.264526:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555945856 offset 0 length 224: 4 00000100:00100000:3.0:1788530525.264601:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530525.264609:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555946112:0@lo:400:kworker.0 00000400:00000100:3.0:1788530525.264639:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946112 offset 0 length 224: 4 00000100:00100000:0.0:1788530525.264791:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555945728:0@lo:38:kworker.0 00000400:00000100:0.0:1788530525.264816:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555945728 offset 0 length 520: 4 00000100:00100000:0.0:1788530525.264830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555945984:0@lo:38:kworker.0 00000400:00000100:0.0:1788530525.264844:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555945984 offset 0 length 520: 4 00010000:00010000:3.0:1788530526.273077:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530527.302934:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530528.320979:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530528.321025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530528.321030:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530528.321033:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530528.321036:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530528.321096:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530528.321099:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788530528.321166:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555946240:0@lo:400:kworker.0 00000400:00000100:2.0:1788530528.321226:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946240 offset 0 length 224: 4 00000100:00100000:3.0:1788530528.321344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555946368:0@lo:400:kworker.0 00000400:00000100:3.0:1788530528.321368:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946368 offset 0 length 224: 4 00000020:01000004:3.0:1788530528.713678:0:21154:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:3.0:1788530528.723853:0:21154:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788530528.723912:0:21154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530528.723927:0:21154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530528.723934:0:21154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530528.723941:0:21154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530528.723965:0:21154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788530528.723985:0:21154:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 10000000:01000000:3.0:1788530528.724001:0:21154:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788530528.724028:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788530528.724041:0:21154:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df93100 x1875409555945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530528.724060:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788530528.724065:0:21154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788530528.724070:0:21154:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788530528.724075:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788530528.724078:0:21154:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df93100 x1875409555945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530540 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530528.724084:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788530528.724086:0:21154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788530528.724611:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555945728:0@lo:38:kworker.0 00000100:00080000:3.0:1788530528.726273:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530528.726294:0:21154:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df93b80 x1875409555945856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530541 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530528.727885:0:21154:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3960d500 x1875409555946240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530528.727901:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788530528.727910:0:21154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788530528.727937:0:21154:0:(import.c:65:import_set_state_nolock()) ffff9a9e025e9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788530528.729344:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530528.729357:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530528.729385:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ba00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530528.729390:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530528.729402:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530528.729409:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530528.729414:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530528.729417:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788530528.729421:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788530528.729468:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:0.0:1788530528.729473:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530528.729479:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530528.729495:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530528.729498:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530528.729499:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530528.731493:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555946240:0@lo:400:kworker.0 00000100:00100000:0.0:1788530528.734430:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555946496:0@lo:39:umount.0 00000400:00000100:0.0:1788530528.734493:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946496 offset 0 length 224: 4 00000100:00100000:1.0:1788530528.734712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555945856:0@lo:400:kworker.0 00000001:00100000:1.0:1788530528.835600:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530528.835611:0:19495:0:(genops.c:885:class_export_put()) final put ffff9a9f274f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788530528.836018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274f8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788530528.836077:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f274f9000 for lustre-OST0001 00000001:00100000:2.0:1788530528.837169:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788530528.837177:0:18663:0:(genops.c:885:class_export_put()) final put ffff9a9f274bc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788530528.837293:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274bc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788530528.837343:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f274b8000 for lustre-OST0000 00010000:00010000:3.0:1788530529.347143:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530530.371390:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530530.373080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530530.373094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530530.373097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530530.373101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530530.373315:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530530.373339:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555946624:0@lo:400:kworker.0 00000400:00000100:0.0:1788530530.373408:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946624 offset 0 length 224: 4 00010000:00010000:0.0:1788530531.393542:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530532.424156:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530533.440856:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530533.888720:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530523/real 1788530523] req@ffff9a9f3960ce00 x1875409555945600/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788530533 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530533.888755:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f3960ce00 x1875409555945600/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788530533 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530533.888776:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530533.888800:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788530533.888804:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555945600:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788530533.892940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530533.892952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788530533.892956:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530533.892964:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 731 00000100:00080000:3.0:1788530533.892971:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788530533.892980:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9f3d0c4000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530533.893020:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df90700 x1875409555946752/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530533.893055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788530533.893061:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530533.893118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555946880:0@lo:400:kworker.0 00000400:00000100:3.0:1788530533.893183:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555946880 offset 0 length 224: 4 00000100:00100000:0.0:1788530533.893585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555946752:0@lo:250:kworker.0 00000400:00000100:0.0:1788530533.893616:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555946752 offset 0 length 520: 4 00010000:00010000:0.0:1788530534.464910:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530535.488776:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530536.513199:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530537.537545:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530538.560787:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530539.008824:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530528/real 1788530528] req@ffff9a9f3df92d80 x1875409555946496/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530539.008857:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f3df92d80 x1875409555946496/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530539.008877:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e025e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788530539.009034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555946496:0@lo:39:umount.0 00000100:00080000:3.0:1788530539.012876:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530539.012885:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788530539.012893:0:21154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788530539.016341:0:21154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016362:0:21154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016370:0:21154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016397:0:21154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016426:0:21154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788530539.016445:0:21154:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-OST0000 00010000:00010000:3.0:1788530539.016450:0:21154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016457:0:21154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016464:0:21154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016470:0:21154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016502:0:21154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788530539.016509:0:21154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016515:0:21154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016521:0:21154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016527:0:21154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016549:0:21154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788530539.016575:0:21154:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 00010000:00010000:3.0:1788530539.016580:0:21154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016587:0:21154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016594:0:21154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016599:0:21154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530539.016606:0:21154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788530539.016645:0:21154:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:3.0:1788530539.016649:0:21154:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788530539.016672:0:21154:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788530539.016676:0:21154:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788530539.016681:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530539.016686:0:21154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788530539.016690:0:21154:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a9e027be620) has no exports 00000020:00080000:3.0:1788530539.016710:0:21154:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a9e027be620) has no exports 00010000:00010000:1.0:1788530539.018383:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788530539.018396:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018406:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a800 already unused, calling callback (ffffffffc1349e00) 00000020:01000000:3.0:1788530539.018408:0:21154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e0226e360 - data ffff9a9f2beada20/ffff9a9e04522c00 10000000:00010000:1.0:1788530539.018410:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018437:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530539.018444:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530539.018450:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530539.018463:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 10000000:01000000:1.0:1788530539.018466:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788530539.018518:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530539.018522:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018529:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018541:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530539.018544:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018546:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530539.018550:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530539.018552:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018557:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018585:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530539.018587:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018594:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530539.018601:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018606:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530539.018606:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788530539.018609:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:0.0:1788530539.018611:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:00010000:1.0:1788530539.018612:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530539.018626:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530539.018628:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788530539.018630:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788530539.018644:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:0.0:1788530539.018644:0:18991:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530539.018648:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018648:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018655:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018655:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018666:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530539.018666:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530539.018668:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530539.018669:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530539.018670:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530539.018674:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530539.018677:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018683:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530539.018689:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530539.018693:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530539.018695:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788530539.018697:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788530539.018718:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530539.018721:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018734:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530539.018743:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530539.018745:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530539.018747:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530539.018843:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788530539.021764:0:21154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f3d0f9720 - data ffff9a9f0ae71948/ffff9a9e03dfb400 00100000:10000000:2.0:1788530539.057921:0:21154:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788530539.069915:0:21154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257518f4 00000020:00000080:3.0:1788530539.069929:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9f274d9800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788530539.069948:0:21154:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0519b800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788530539.069952:0:21154:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0519b800 2 00000020:01000004:3.0:1788530539.069967:0:21154:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f0519b800 from lustre-OST0000 00000020:00000080:3.0:1788530539.070000:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530539.070011:0:21154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788530539.070014:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9f274d8800/lustre-OST0000_UUID 00000020:00000080:3.0:1788530539.070017:0:21154:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274d8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788530539.070024:0:21154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788530539.070238:0:21154:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788530539.070242:0:21154:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788530539.070246:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530539.070251:0:21154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530539.070258:0:21154:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a9e025ea800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530539.070263:0:21154:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9a9f39656620) has exports, disconnecting them 00000020:00080000:3.0:1788530539.070268:0:21154:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a9e025ea800), last request at 1788530443 00000020:00000080:3.0:1788530539.070272:0:21154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575192c 00000020:00080000:3.0:1788530539.070283:0:21154:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e025ea800): rc 0 00000020:00000080:3.0:1788530539.070287:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9e025ea800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788530539.072725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f274d9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788530539.072746:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025ea800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000100:00080000:1.0:1788530539.076721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530539.076733:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530539.076735:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530539.076738:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788530539.076824:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530539.076843:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555947008:0@lo:400:kworker.0 00000400:00000100:1.0:1788530539.076898:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555947008 offset 0 length 224: 4 00010000:01000000:0.0:1788530539.176449:0:21154:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788530539.176469:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530539.176473:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788530539.176481:0:21154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788530539.176725:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530539.176754:0:21154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788530539.176761:0:21154:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788530539.176765:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530539.176770:0:21154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788530539.176777:0:21154:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a9e03344000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530539.176784:0:21154:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9a9f39650000) has exports, disconnecting them 00000020:00080000:0.0:1788530539.176789:0:21154:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a9e03344000), last request at 1788530443 00000020:00000080:0.0:1788530539.176793:0:21154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751941 00000020:00080000:0.0:1788530539.176809:0:21154:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e03344000): rc 0 00000020:00000080:0.0:1788530539.176815:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9e03344000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788530539.177501:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e025eb800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788530539.177512:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9e025e9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788530539.177515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025e9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788530539.177531:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788530539.177614:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03344000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788530539.185629:0:21154:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788530539.185639:0:21154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530539.185644:0:21154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788530539.185652:0:21154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788530539.185702:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e025e9800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788530539.185884:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530539.185892:0:21154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788530539.185898:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9e025ef800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788530539.185902:0:21154:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025ef800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788530539.185907:0:21154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788530539.185972:0:21154:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0519b800 1 00000020:00000080:1.0:1788530539.185978:0:21154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257518c3 00000020:00000080:1.0:1788530539.185985:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9f0aa1a800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788530539.185994:0:21154:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788530539.186002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0aa1a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788530539.186012:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530539.186016:0:21154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530539.186019:0:21154:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9a9f32880000) has no exports 00000020:00000080:3.0:1788530539.234167:0:21154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530539.234184:0:21154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788530539.234189:0:21154:0:(genops.c:885:class_export_put()) final put ffff9a9f0519e000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788530539.234194:0:21154:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0519e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788530539.234206:0:21154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788530539.234343:0:21154:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9f0519f000 00000020:02000400:3.0:1788530539.234392:0:21154:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788530539.585307:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530540.035174:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530525/real 1788530525] req@ffff9a9f3df91180 x1875409555945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788530540 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530540.035206:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f3df91180 x1875409555945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788530540 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530540.035226:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530540.035247:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530540.035251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555945984:0@lo:38:kworker.0 00000100:00080000:1.0:1788530540.035310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530540.035316:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530540.035318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530540.035321:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788530540.035324:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530540.035329:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 733 00000100:00080000:1.0:1788530540.035335:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530540.035343:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e01b16800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530540.035377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375ca80 x1875409555947136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530540.035458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555947264:0@lo:400:kworker.0 00000400:00000100:1.0:1788530540.035518:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555947264 offset 0 length 224: 4 00000100:00100000:0.0:1788530540.035834:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555947136:0@lo:38:kworker.0 00000400:00000100:0.0:1788530540.035857:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555947136 offset 0 length 520: 4 00010000:00010000:3.0:1788530540.609524:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788530541.505100:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530525/real 1788530525] req@ffff9a9f3df92680 x1875409555946112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530541.526235:0:3648:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9a9f3df92680 x1875409555946112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788530541.526252:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fa800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788530541.526268:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788530541.542741:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1788530541.542898:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530541.542905:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530541.542907:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530541.542910:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530541.542930:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530541.542933:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788530541.542936:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530541.542944:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 671 00000100:00080000:2.0:1788530541.542955:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a9f047fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530541.542990:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f32bd3800 x1875409555947392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530541.543043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555946112:0@lo:400:kworker.0 00000100:00100000:3.0:1788530541.543221:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555947392:0@lo:38:kworker.0 00000400:00000100:3.0:1788530541.543271:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555947392 offset 0 length 520: 4 00010000:00010000:2.0:1788530541.633239:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530542.658699:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788530543.159997:0:21356:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:0.0:1788530543.176303:0:21356:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788530543.176401:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.176416:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.176443:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.176462:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.176484:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788530543.176506:0:21356:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 10000000:01000000:0.0:1788530543.176511:0:21356:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788530543.176539:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530543.176549:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375ca80 x1875409555947136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.176601:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788530543.176608:0:21356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788530543.176614:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788530543.176619:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530543.176623:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375ca80 x1875409555947136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530560 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.176631:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788530543.176634:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788530543.176715:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555947136:0@lo:38:kworker.0 00010000:00010000:3.0:1788530543.177861:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530543.177873:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530543.177884:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530543.177888:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530543.177898:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530543.177906:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530543.177911:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788530543.177914:0:17147:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788530543.177917:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788530543.177956:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:3.0:1788530543.177960:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530543.177967:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530543.177980:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530543.177997:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530543.177999:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530543.178408:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788530543.178419:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3960c380 x1875409555946368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178441:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df91f80 x1875409555946624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178450:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df90000 x1875409555946880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178490:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375c000 x1875409555947008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178499:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375fb80 x1875409555947264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530556 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178508:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f32bd3800 x1875409555947392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178522:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788530543.178528:0:21356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788530543.178533:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788530543.178539:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788530543.178543:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3960c380 x1875409555946368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530544 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178551:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df91f80 x1875409555946624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530546 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178578:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df90000 x1875409555946880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530549 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178587:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375c000 x1875409555947008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530555 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178595:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e0375fb80 x1875409555947264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530556 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178602:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f32bd3800 x1875409555947392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530551 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530543.178607:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788530543.178611:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788530543.178697:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555947392:0@lo:38:kworker.0 00000100:00100000:1.0:1788530543.178878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555947008:0@lo:400:kworker.0 00000100:00100000:1.0:1788530543.178886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555946880:0@lo:400:kworker.0 00000100:00100000:3.0:1788530543.179010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555947264:0@lo:400:kworker.0 00000100:00100000:3.0:1788530543.179019:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555946624:0@lo:400:kworker.0 00000100:00100000:3.0:1788530543.179026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555946368:0@lo:400:kworker.0 00010000:00010000:0.0:1788530543.182299:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182340:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182348:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182354:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182380:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788530543.182398:0:21356:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-OST0001 00010000:00010000:0.0:1788530543.182403:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182411:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182416:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182423:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182507:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788530543.182515:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182522:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182536:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.182542:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186658:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530543.186675:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186688:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530543.186693:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186704:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530543.186711:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530543.186726:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530543.186729:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:1.0:1788530543.186744:0:18991:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530543.186747:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186753:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186774:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530543.186777:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186806:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530543.186809:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186816:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530543.186821:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530543.186826:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530543.186828:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788530543.186830:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788530543.186867:0:18991:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530543.186870:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186877:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186890:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530543.186893:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186898:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530543.186900:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186906:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530543.186918:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530543.186923:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788530543.186925:0:18991:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788530543.186930:0:18991:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530543.186932:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.186938:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530543.186940:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530543.186942:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530543.187691:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530543.187701:0:21356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530543.188864:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788530543.189366:0:21356:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 10000000:01000000:0.0:1788530543.189373:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788530543.189408:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.189422:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.189429:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.189435:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530543.189467:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788530543.189506:0:21356:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788530543.189510:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788530543.189541:0:21356:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788530543.189587:0:21356:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788530543.189607:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788530543.189614:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530543.189621:0:21356:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788530543.189625:0:21356:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a9e03779988) has no exports 00000020:00080000:0.0:1788530543.189650:0:21356:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a9e03779988) has no exports 00010000:00010000:1.0:1788530543.189813:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530543.189820:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.189829:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530543.189832:0:18991:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.189841:0:18991:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530543.189847:0:18991:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530543.189852:0:18991:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530543.189855:0:18991:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788530543.189857:0:18991:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788530543.189908:0:18991:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:1.0:1788530543.189912:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.189919:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530543.189934:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530543.189936:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530543.189938:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788530543.196432:0:21356:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e0226e1e0 - data ffff9a9f2be77af8/ffff9a9f3b02f400 00000020:01000000:0.0:1788530543.197834:0:21356:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f3d0f9b40 - data ffff9a9f2bf17360/ffff9a9f3d1a2c00 00010000:00010000:2.0:1788530543.198276:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788530543.218797:0:21356:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788530543.225912:0:21356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751a83 00000020:00000080:0.0:1788530543.225924:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9e025ef000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788530543.225947:0:21356:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e025ec800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788530543.225951:0:21356:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e025ec800 2 00000020:01000004:0.0:1788530543.225954:0:21356:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9e025ec800 from lustre-OST0001 00000020:00000080:0.0:1788530543.225987:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530543.225997:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788530543.226000:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9e02239800/lustre-OST0001_UUID 00000020:00000080:0.0:1788530543.226003:0:21356:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e02239800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788530543.226010:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788530543.226107:0:21356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS 00010000:00010000:0.0:1788530543.226122:0:21356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530543.226146:0:21356:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530543.226153:0:21356:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788530543.226156:0:21356:0:(mgc_request.c:1252:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788530543.226159:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788530543.226203:0:21356:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f3d0c4000 00010000:00010000:0.0:1788530543.226207:0:21356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788530543.226227:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788530543.226240:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788530543.226243:0:21356:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788530543.226244:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788530543.226249:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788530543.226258:0:21356:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3df90700 x1875409555946752/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788530548 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788530543.226316:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788530543.226320:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:2.0:1788530543.226478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788530543.226775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555946752:0@lo:250:kworker.0 10000000:01000000:0.0:1788530543.226931:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788530543.226939:0:21356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575165b 00000020:00000080:0.0:1788530543.226945:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95f000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 00000020:01000000:0.0:1788530543.226983:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.141@tcp (flags='') 00000020:00000080:0.0:1788530543.226988:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530543.226994:0:21356:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788530543.226998:0:21356:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a9e027b8000) has no exports 00000020:00000080:2.0:1788530543.227032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95f000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 for MGC192.168.202.141@tcp 10000000:01000000:3.0:1788530543.227113:0:17156:0:(mgc_request.c:982:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788530543.227431:0:21356:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.202.141@tcp: client import never connected 00000100:00080000:0.0:1788530543.227435:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788530543.227438:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788530543.227440:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788530543.227442:0:21356:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788530543.227492:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530543.227497:0:21356:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.141@tcp (uuid 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219) 00000020:01000000:0.0:1788530543.227502:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788530543.227506:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530543.227509:0:21356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788530543.227515:0:21356:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a9f047fe000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530543.227520:0:21356:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9a9e0377b310) has exports, disconnecting them 00000020:00080000:0.0:1788530543.227525:0:21356:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a9f047fe000), last request at 1788530463 00000020:00000080:0.0:1788530543.227529:0:21356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751abb 00000020:00080000:0.0:1788530543.227539:0:21356:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f047fe000): rc 0 00000020:00000080:0.0:1788530543.227544:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9f047fe000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788530543.227805:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3d0c4000 for MGC192.168.202.141@tcp 00000020:00000080:2.0:1788530543.227812:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9f202ab000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 00000020:00000080:2.0:1788530543.227815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f202ab000/516d0d0a-8182-4c2b-8a3c-00c8cd0e9219 for MGC192.168.202.141@tcp 00000020:01000000:2.0:1788530543.227821:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.141@tcp (516d0d0a-8182-4c2b-8a3c-00c8cd0e9219) 00000020:00000080:2.0:1788530543.229076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047fe000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788530543.230640:0:21356:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788530543.230647:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530543.230651:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788530543.230658:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530543.230841:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530543.230857:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788530543.230864:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788530543.230868:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530543.230872:0:21356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788530543.230878:0:21356:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a9f047fc800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530543.230884:0:21356:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9a9f04533310) has exports, disconnecting them 00000020:00080000:2.0:1788530543.230888:0:21356:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a9f047fc800), last request at 1788530463 00000020:00000080:2.0:1788530543.230892:0:21356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751ad0 00000020:00080000:2.0:1788530543.230905:0:21356:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f047fc800): rc 0 00000020:00000080:2.0:1788530543.230909:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9f047fc800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788530543.231307:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e01b16800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788530543.231315:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9e01b15000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788530543.231318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01b15000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788530543.231330:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788530543.231401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047fc800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788530543.333621:0:21356:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788530543.333632:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530543.333637:0:21356:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788530543.333645:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788530543.333718:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788530543.334388:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1788530543.334661:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f047fa800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788530543.337087:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788530543.337414:0:17142:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a9e02426600:17142] 0 exiting: rc = 1 00000100:00100000:0.0:1788530543.338343:0:17143:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a9f32a25c00:17143] 1 exiting: rc = 0 00000100:00100000:3.0:1788530543.342750:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530543.348146:0:17144:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a9f12409000:17144] 0 exiting: rc = 1 00000100:00100000:0.0:1788530543.348272:0:17146:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a9f12409400:17146] 2 exiting: rc = 0 00000100:00100000:0.0:1788530543.351053:0:17145:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a9f12408c00:17145] 1 exiting: rc = 0 00000100:00100000:3.0:1788530543.353959:0:20204:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a9e0451ec00:20204] 3 exiting: rc = 0 00000100:00100000:2.0:1788530543.356814:0:20205:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9a9e03e42a00:20205] 4 exiting: rc = 0 00000100:00100000:3.0:1788530543.357429:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357438:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357444:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357460:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357466:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357484:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357490:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357495:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357500:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357505:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357511:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357518:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357523:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357528:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357534:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357540:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357544:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357549:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357555:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357582:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357590:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357595:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357600:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357605:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357611:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357617:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357622:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357628:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357633:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357638:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357643:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357648:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357653:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357659:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357665:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357670:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357675:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357681:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357686:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357691:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357706:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357711:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357726:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357733:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357739:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357745:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357749:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357754:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357758:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357763:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357768:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357773:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357778:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357782:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357787:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357792:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357796:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357801:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357805:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357810:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357815:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357820:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357825:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.357830:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788530543.361923:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530543.361937:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788530543.361943:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9f047f9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788530543.361947:0:21356:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f047f9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788530543.361954:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788530543.362007:0:21356:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e025ec800 1 00000020:00000080:3.0:1788530543.362013:0:21356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125751a59 00000020:00000080:3.0:1788530543.362019:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9e0223e000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788530543.362031:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788530543.362034:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530543.362046:0:21356:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788530543.362050:0:21356:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9a9f39654c98) has no exports 00000020:00000080:0.0:1788530543.363084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0223e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788530543.413587:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530543.413603:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788530543.413608:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9e025ee000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788530543.413613:0:21356:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025ee000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788530543.413626:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788530543.413938:0:21356:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9e025ed000 00000020:01000000:1.0:1788530543.413964:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788530543.413970:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530543.413975:0:21356:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530543.413979:0:21356:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a9f3d214c98) has no exports 00000020:00000080:1.0:1788530543.414006:0:21356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530543.414012:0:21356:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788530543.414016:0:21356:0:(genops.c:885:class_export_put()) final put ffff9a9f0aa18800/OSS_uuid 00000020:00000080:1.0:1788530543.414018:0:21356:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0aa18800/OSS_uuid for OSS 00000020:01000000:1.0:1788530543.414021:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788530543.414054:0:17155:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788530543.414248:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a9e02234200:18669] 2 exiting: rc = 0 00000100:00100000:1.0:1788530543.414304:0:18966:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a9e03edf200:18966] 3 exiting: rc = 0 00000100:00100000:1.0:1788530543.414358:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a9f2b966e00:18666] 0 exiting: rc = 1 00000100:00100000:1.0:1788530543.414415:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a9f04068a00:18667] 1 exiting: rc = 0 00000100:00100000:1.0:1788530543.414494:0:20517:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a9e03ea9e00:20517] 4 exiting: rc = 0 00000100:00100000:1.0:1788530543.414558:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414590:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414596:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414601:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414607:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414612:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414618:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414623:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414628:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414634:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414639:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414644:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414649:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414655:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414660:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414665:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414671:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414676:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414682:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414687:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414692:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414698:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414704:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414709:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414714:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414720:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414725:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414730:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414735:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414739:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414744:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414749:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414755:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414760:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414773:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414778:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414783:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414788:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414794:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414799:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414805:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414810:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414814:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414819:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414824:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414829:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414834:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414839:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414844:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414849:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414854:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414859:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414864:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414870:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414876:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414880:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414885:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414890:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414895:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414900:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414905:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414909:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414919:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.414925:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530543.420962:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a9f2029e800:18671] 1 exiting: rc = 0 00000100:00100000:2.0:1788530543.422188:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a9f2029fe00:18670] 0 exiting: rc = 1 00000100:00100000:1.0:1788530543.424320:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424330:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424337:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424341:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424347:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424382:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424387:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424392:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424415:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424421:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424427:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424432:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424437:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424442:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424447:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424464:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424470:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424474:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424479:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424484:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424490:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424495:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424499:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424505:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424509:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424514:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424520:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424526:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424531:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424535:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424540:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424545:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424551:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424557:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424587:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424593:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424598:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424603:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424607:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424612:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424624:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424629:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424634:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424639:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424645:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424650:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424656:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424661:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424665:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424670:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424676:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424680:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424685:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424691:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424696:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424701:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424706:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424712:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424886:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424894:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424899:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424904:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424909:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.424914:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.431816:0:18672:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a9f0ccbda00:18672] 0 exiting: rc = 1 00000100:00100000:0.0:1788530543.449511:0:18674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a9f08cc9400:18674] 2 exiting: rc = 0 00000100:00100000:2.0:1788530543.462910:0:18673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a9f0ccbd600:18673] 1 exiting: rc = 0 00000100:00100000:1.0:1788530543.463189:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463198:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463203:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463218:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463226:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463232:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463239:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463244:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463250:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463255:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463273:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463279:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463285:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463290:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463295:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463301:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463306:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463312:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463317:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463323:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463338:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463343:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463359:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463365:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463371:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463376:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463381:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463386:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463391:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463395:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463400:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463405:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463409:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463414:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463419:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463424:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463429:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463446:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463460:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463466:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463471:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463477:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463482:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463487:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463506:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463518:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463523:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463529:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463534:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463540:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463545:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463550:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463556:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463592:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463599:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463604:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463618:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463625:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463630:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463636:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463642:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463648:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463653:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530543.463659:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530543.468117:0:18675:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a9f08cf9400:18675] 0 exiting: rc = 1 00000100:00100000:1.0:1788530543.468423:0:18676:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a9f08cc8600:18676] 1 exiting: rc = 0 00000100:00100000:2.0:1788530543.468695:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468702:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468707:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468712:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468784:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468791:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468797:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468802:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468808:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468813:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468819:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468826:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468832:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468838:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468843:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468849:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468854:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468859:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468865:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468881:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468887:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468892:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468898:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468903:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468908:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468914:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468919:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468924:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468930:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468935:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468940:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468947:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468952:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468957:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468962:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468967:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468972:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.468978:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469000:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469007:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469012:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469018:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469023:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469028:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469034:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469039:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469044:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469049:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469054:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469059:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469064:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469069:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469074:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469078:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469091:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469097:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469103:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469108:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469113:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469119:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469124:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469130:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469135:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530543.469146:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470499:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a9f3bd1c200:18677] 0 exiting: rc = 1 00000100:00100000:0.0:1788530543.470639:0:18678:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a9f08cf9a00:18678] 1 exiting: rc = 0 00000100:00100000:3.0:1788530543.470807:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470814:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470820:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470827:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470852:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470860:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470865:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470872:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470879:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470884:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470890:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470897:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470903:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470909:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470914:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470920:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470941:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470949:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470955:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470961:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470967:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470973:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470979:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470986:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470992:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.470998:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471004:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471010:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471032:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471039:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471047:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471053:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471070:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471076:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471082:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471088:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471094:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471100:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471107:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471115:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471139:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471147:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471154:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471160:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471166:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471274:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471283:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471289:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471295:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471302:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471309:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471317:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471339:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471346:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471362:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471368:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471375:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471382:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471387:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471394:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471401:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471408:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471414:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530543.471422:0:21356:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788530543.497912:0:21356:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788530564.717416:0:22120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788530578.261302:0:22720:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788530578.261308:0:22720:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788530578.261309:0:22720:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788530578.261416:0:22720:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f3b266000 00000020:01000004:1.0:1788530578.261431:0:22720:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788530578.261438:0:22720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788530578.261480:0:22720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a9f04534c98) 00000020:00000080:1.0:1788530578.261494:0:22720:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788530578.326602:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.328370:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788530578.330297:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.330619:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.330996:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.331360:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.331745:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.331913:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.332182:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.332496:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.332716:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.332889:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.333092:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.333292:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788530578.334882:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.335798:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.336009:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.336223:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.336528:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.336723:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.336903:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.337089:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.337284:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.337554:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.337855:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.338022:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.339081:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.339338:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.339709:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.339887:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.340142:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.340310:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.340630:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.340880:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.341114:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.341314:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.342177:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.342371:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.342771:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.342935:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.343145:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.343343:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.343781:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.343969:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788530578.344176:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.344579:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.344768:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788530578.345747:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.346059:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.346220:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.346722:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.347154:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788530578.347396:0:22720:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788530578.348248:0:22720:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788530578.348669:0:22720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788530578.348678:0:22720:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788530578.348689:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125751fd8 00000020:01000004:1.0:1788530578.348696:0:22720:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788530578.348709:0:22720:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788530578.348713:0:22720:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f3b266000 from MGS 00000020:01000004:1.0:1788530578.348717:0:22720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788530578.348727:0:22720:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a9f04536620) 00000020:00000080:1.0:1788530578.348737:0:22720:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788530578.348794:0:22720:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f3b266000 from MGS, refs=2 00080000:01000000:1.0:1788530578.348800:0:22720:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788530578.348805:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125751fe6 00000100:00100000:1.0:1788530578.348896:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788530578.349021:0:22720:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788530578.349027:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788530578.349716:0:22720:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788530578.349785:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788530578.350363:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530578.350851:0:22720:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788530578.350858:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788530578.351310:0:22720:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788530578.351317:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788530578.351850:0:22720:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788530578.351855:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788530578.352394:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.352397:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.352399:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.356136:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.356142:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.356145:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530578.357107:0:22720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1788530578.361241:0:22720:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1788530578.362334:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788530578.362376:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788530578.362485:0:22720:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788530578.362522:0:22720:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788530578.363261:0:22720:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788530578.363775:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530578.363916:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788530578.363921:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788530578.365953:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788530578.365962:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788530578.369187:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788530578.369198:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788530578.369959:0:22720:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788530578.369978:0:22720:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:0.0:1788530578.369980:0:22720:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788530578.370008:0:22720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:0.0:1788530578.370020:0:22720:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (ffff9a9e03779988) 00000020:00000080:0.0:1788530578.370035:0:22720:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788530578.370101:0:22720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e01b10800@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530578.370249:0:22720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:0.0:1788530578.370255:0:22720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788530578.370349:0:22737:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788530578.373642:0:22738:0:(mgc_request.c:893:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788530578.373720:0:22720:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid fdaa18b0-da07-49cb-a5c5-729ae13b1075) 00000020:00000080:3.0:1788530578.373741:0:22720:0:(genops.c:1385:class_connect()) connect: client fdaa18b0-da07-49cb-a5c5-729ae13b1075, cookie 0xb28d70e125751ff4 00000100:00080000:3.0:1788530578.373753:0:22720:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530578.373760:0:22720:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9e01b10800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530578.373789:0:22720:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df90700 x1875409555947520/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530578.373819:0:22720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fdaa18b0-da07-49cb-a5c5-729ae13b1075->MGS 00000020:01000004:3.0:1788530578.373865:0:22720:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788530578.373871:0:22720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788530578.373884:0:22720:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a9f39653310) 00000020:00000080:3.0:1788530578.373895:0:22720:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788530578.374577:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3646:1875409555947520:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788530578.374641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.374703:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555947520 00000100:00100000:0.0:1788530578.374710:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555947520 00000100:00100000:0.0:1788530578.374734:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530578.374741:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875409555947520:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788530578.374762:0:22733:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from fdaa18b0-da07-49cb-a5c5-729ae13b1075@0@lo t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:0.0:1788530578.374783:0:22733:0:(genops.c:1385:class_connect()) connect: client fdaa18b0-da07-49cb-a5c5-729ae13b1075, cookie 0xb28d70e125752002 00000100:00080000:0.0:1788530578.374885:0:22733:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530578.374926:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:3646:x1875409555947520:12345-0@lo:250:mount.lustre.0 Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.374932:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530578.374968:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788530578.374976:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:0.0:1788530578.374982:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788530578.374986:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788530578.374989:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b10800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788530578.374991:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788530578.374998:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788530578.375002:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3646:1875409555947520:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788530578.390011:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530578.390190:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788530578.390196:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788530578.391371:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530578.391379:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788530578.391838:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530578.391843:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788530578.392397:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530578.392686:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788530578.392690:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788530578.395545:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788530578.395556:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788530578.429795:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530578.429988:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788530578.429994:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788530578.431831:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788530578.431842:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788530578.432360:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530578.432829:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788530578.432834:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788530578.433347:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530578.433354:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788530578.434054:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530578.434253:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788530578.434257:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788530578.435081:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530578.435088:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788530578.435841:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530578.435977:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788530578.435982:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788530578.436535:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530578.436541:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788530578.450962:0:22720:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530578.451172:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788530578.451179:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788530578.452791:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530578.452801:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788530578.453549:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788530578.453584:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788530578.454308:0:22720:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788530578.454348:0:22720:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788530578.454353:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788530578.454355:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530578.454357:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530578.454358:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530578.454360:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530578.454361:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530578.454363:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530578.454364:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530578.454366:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530578.454367:0:22720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530578.454370:0:22720:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788530578.454373:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530578.454374:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530578.454375:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530578.454376:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530578.454377:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530578.454378:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530578.454379:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530578.454380:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530578.454381:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530578.454498:0:22720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530578.454527:0:22720:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788530578.454547:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947648:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530578.454683:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530578.454721:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.454850:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555947648 00000100:00100000:3.0:1788530578.454857:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555947648 00000100:00100000:3.0:1788530578.454898:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530578.454907:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22720:x1875409555947648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788530578.454946:0:22736:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788530578.454949:0:22736:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788530578.454952:0:22736:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788530578.455241:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788530578.455799:0:22736:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788530578.457007:0:22758:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788530578.457013:0:22758:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788530578.457016:0:22758:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788530578.457019:0:22758:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788530578.457175:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788530578.457348:0:22736:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788530578.457357:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788530578.459114:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22720:x1875409555947648:12345-0@lo:253:mount.lustre.0 Request processed in 4201us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530578.459140:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530578.459213:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788530578.459234:0:22720:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788530578.459237:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788530578.459239:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530578.459241:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530578.459242:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530578.459243:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530578.459244:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530578.459246:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530578.459247:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530578.459249:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530578.459250:0:22720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788530578.459265:0:22720:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f3b266000 from lustre-MDT0000 10000000:01000000:1.0:1788530578.459293:0:22720:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788530578.459295:0:22720:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788530578.459299:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f3b266000 10000000:01000000:1.0:1788530578.459304:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530578.459324:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f3b266000 from 1 10000000:01000000:1.0:1788530578.459327:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530578.459360:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.459371:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.459381:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530578.459540:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530578.459708:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530578.459764:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.459802:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555947776 00000100:00100000:0.0:1788530578.459814:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555947776 00000100:00100000:0.0:1788530578.459878:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530578.459885:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22720:x1875409555947776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530578.459897:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530578.459909:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3400/0xb28d70e125752010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752009 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.459930:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3400/0xb28d70e125752010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752009 expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.459940:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3400/0xb28d70e125752010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752009 expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.459947:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3400, rc 0) 00000100:00100000:0.0:1788530578.459985:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22720:x1875409555947776:12345-0@lo:101:mount.lustre.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.459991:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530578.460043:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530578.460055:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752010 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460065:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752010 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.460094:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.460116:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.460265:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03942b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.460321:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555947904 00000100:00100000:1.0:1788530578.460326:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555947904 00000100:00100000:1.0:1788530578.460344:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530578.460355:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22720:x1875409555947904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530578.460432:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22720:x1875409555947904:12345-0@lo:501:mount.lustre.0 Request processed in 77us (315us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530578.460521:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555947904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788530578.460533:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530578.460546:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752010 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460554:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125752009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752010 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530578.460577:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f3b266000 10000000:01000000:3.0:1788530578.460588:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788530578.460607:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9f3b266000 10000000:01000000:3.0:1788530578.460610:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788530578.460635:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9f3b266000 from 1 10000000:01000000:3.0:1788530578.460638:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788530578.460656:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460664:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460671:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.460682:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530578.460707:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.460716:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03942b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.460763:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530578.460782:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948032 00000100:00100000:1.0:1788530578.460785:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948032 00000100:00100000:1.0:1788530578.460798:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530578.460803:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22720:x1875409555948032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530578.460809:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530578.460818:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575201e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752017 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.460831:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575201e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752017 expref: 7 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.460839:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575201e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752017 expref: 7 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.460846:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167e00, rc 0) 00000100:00100000:1.0:1788530578.460878:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+7:22720:x1875409555948032:12345-0@lo:101:mount.lustre.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.460884:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530578.460943:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530578.460953:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575201e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460960:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575201e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530578.460971:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788530578.460975:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575201e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.460981:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f00031400/0xb28d70e125752017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575201e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530578.460994:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788530578.460997:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530578.461018:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f3b266000 10000000:01000000:3.0:1788530578.461021:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788530578.461041:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788530578.461044:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788530578.461056:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.461064:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.461071:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.461081:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530578.461102:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.461130:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03942b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.461274:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948160 00000100:00100000:1.0:1788530578.461278:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948160 00000100:00100000:1.0:1788530578.461293:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530578.461299:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+7:22720:x1875409555948160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530578.461305:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530578.461312:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166400/0xb28d70e12575202c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752025 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.461329:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166400/0xb28d70e12575202c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752025 expref: 8 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.461338:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166400/0xb28d70e12575202c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752025 expref: 8 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.461344:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166400, rc 0) 00000100:00100000:1.0:1788530578.461376:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+8:22720:x1875409555948160:12345-0@lo:101:mount.lustre.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.461530:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530578.461540:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575202c expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.461547:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575202c expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.461586:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.461608:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.461633:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03942b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.461678:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530578.461696:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948288 00000100:00100000:1.0:1788530578.461699:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948288 00000100:00100000:1.0:1788530578.461711:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530578.461716:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+8:22720:x1875409555948288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530578.461817:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22720:x1875409555948288:12345-0@lo:501:mount.lustre.0 Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.461824:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530578.461913:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.461935:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530578.461966:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.461980:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03942b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.462024:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948416 00000100:00100000:1.0:1788530578.462028:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948416 00000100:00100000:1.0:1788530578.462044:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530578.462049:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22720:x1875409555948416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530578.462941:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22720:x1875409555948416:12345-0@lo:503:mount.lustre.0 Request processed in 889us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.462950:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530578.463026:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555948416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530578.463851:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22759:1875409555948544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530578.463893:0:22759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.463954:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.463981:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948544 00000100:00100000:1.0:1788530578.463987:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948544 00000100:00100000:1.0:1788530578.464102:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530578.464110:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22759:x1875409555948544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530578.464721:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22759:x1875409555948544:12345-0@lo:502:llog_process_th.0 Request processed in 610us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.464729:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530578.464846:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22759:1875409555948544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788530578.464873:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530578.464883:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530578.464885:0:22759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788530578.464890:0:22759:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788530578.464893:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530578.464906:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a9f39651988) 00000020:00000080:3.0:1788530578.464920:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788530578.464926:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788530578.464988:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788530578.464994:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575203a 00000020:00000080:3.0:1788530578.465192:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788530578.465196:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530578.465199:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530578.465201:0:22759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788530578.465203:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530578.465206:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530578.465208:0:22759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788530578.465211:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530578.465217:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a9f39654c98) 00000020:00000080:3.0:1788530578.465226:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788530578.465229:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788530578.465231:0:22759:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788530578.465238:0:22759:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788530578.465245:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788530578.465280:0:22759:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f3b266000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788530578.465290:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a9f39650000) 00000020:00000080:3.0:1788530578.465297:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788530578.465347:0:22759:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788530578.465351:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e12575204f 00000020:00000080:3.0:1788530578.465459:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788530578.465465:0:22759:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788530578.465469:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb28d70e125752056 00080000:01000000:3.0:1788530578.465474:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788530578.465477:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575205d 00010000:00010000:2.0:1788530578.555069:0:22759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788530578.556686:0:22759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1788530578.557169:0:22759:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788530578.559589:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a9f32884c98) 00000020:00000080:2.0:1788530578.559610:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788530578.559685:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788530578.559691:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575206b 00000020:00000080:0.0:1788530578.564399:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788530578.568957:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb28d70e125752072 00000020:00000080:2.0:1788530578.569316:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788530578.569327:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530578.569333:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530578.569335:0:22759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788530578.569338:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788530578.569340:0:22759:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788530578.569342:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530578.569344:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530578.569345:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788530578.569348:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530578.569349:0:22759:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788530578.569357:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530578.569362:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530578.569363:0:22759:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788530578.569367:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788530578.569418:0:22759:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788530578.569432:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530578.569434:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530578.569436:0:22759:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788530578.569439:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530578.569442:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530578.569443:0:22759:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788530578.569446:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530578.569451:0:22759:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:2.0:1788530578.569475:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530578.569488:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a9f32883310) 00000020:00000080:2.0:1788530578.569498:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788530578.569502:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530578.569548:0:22759:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788530578.569553:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788530578.569557:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125752080 00010000:00080000:2.0:1788530578.569613:0:22759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e01aa3000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530578.571045:0:22759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788530578.576818:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788530578.576832:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788530578.576869:0:22759:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788530578.576888:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125752087 00000100:00080000:1.0:1788530578.576897:0:22759:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530578.576903:0:22759:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e01aa3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530578.576937:0:22759:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375d500 x1875409555948672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530578.577000:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788530578.577068:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530578.577184:0:22759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788530578.577266:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530578.577270:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.577272:0:22759:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788530578.577275:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788530578.577277:0:22759:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788530578.577279:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530578.577281:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530578.577282:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788530578.577284:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.577286:0:22759:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788530578.577288:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788530578.577292:0:22759:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788530578.577296:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.577297:0:22759:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788530578.577300:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788530578.577304:0:22759:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:1.0:1788530578.577326:0:22759:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788530578.577329:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530578.577340:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a9f04530000) 00000020:00000080:1.0:1788530578.577351:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788530578.577355:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788530578.577507:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555948672 00000100:00100000:3.0:1788530578.577516:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555948672 00000100:00100000:3.0:1788530578.577546:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530578.577554:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555948672:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788530578.577586:0:22746:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:1.0:1788530578.581656:0:22759:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788530578.581667:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788530578.581679:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125752095 00010000:00080000:1.0:1788530578.581717:0:22759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e01aa1000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530578.581942:0:22759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788530578.583696:0:22759:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788530578.583895:0:22759:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788530578.587686:0:22759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530578.587919:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1788530578.591576:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555948672:12345-0@lo:38:llog_process_th.0 Request processed in 13996us (14482us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530578.591592:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788530578.591700:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530578.591705:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530578.591709:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948672:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788530578.595810:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788530578.599834:0:22765:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788530578.599840:0:22765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788530578.600771:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788530578.600783:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788530578.600816:0:22759:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788530578.600834:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e12575209c 00000100:00080000:1.0:1788530578.600844:0:22759:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530578.600852:0:22759:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e01aa1000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530578.600886:0:22759:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375c000 x1875409555948800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530578.600911:0:22759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788530578.600950:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530578.600953:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.600955:0:22759:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788530578.600958:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788530578.600966:0:22759:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788530578.600967:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530578.600969:0:22759:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530578.600971:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788530578.600973:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.600975:0:22759:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788530578.600977:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788530578.600981:0:22759:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788530578.600986:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.600987:0:22759:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788530578.600989:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788530578.600993:0:22759:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:1.0:1788530578.601016:0:22759:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788530578.601019:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530578.601029:0:22759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a9f04533310) 00000020:00000080:1.0:1788530578.601040:0:22759:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788530578.601044:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788530578.601090:0:22759:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788530578.601095:0:22759:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788530578.601101:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257520aa 00010000:00080000:1.0:1788530578.601138:0:22759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e024de800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530578.601320:0:22759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788530578.601380:0:22759:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788530578.601405:0:22759:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788530578.601506:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948800:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788530578.601572:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555948800 offset 0 length 520: 4 00000040:00080000:1.0:1788530578.605264:0:22759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530578.605480:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788530578.605774:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788530578.606250:0:22767:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788530578.606256:0:22767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788530578.611157:0:22759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788530578.611175:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788530578.611221:0:22759:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788530578.611240:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257520b1 00000100:00080000:1.0:1788530578.611251:0:22759:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530578.611262:0:22759:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530578.611297:0:22759:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375d880 x1875409555948928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530578.611363:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948928:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788530578.611535:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555948928 offset 0 length 520: 4 00000100:00080000:1.0:1788530578.611724:0:22759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788530578.611784:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530578.611788:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.611790:0:22759:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788530578.611792:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530578.611796:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.611798:0:22759:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788530578.611800:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788530578.611802:0:22759:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788530578.611804:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530578.611806:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.611807:0:22759:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788530578.611809:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530578.611811:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530578.611812:0:22759:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788530578.611815:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788530578.611840:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22759:1875409555949056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530578.611884:0:22759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530578.611906:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.611966:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949056 00000100:00100000:0.0:1788530578.611977:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949056 00000100:00100000:0.0:1788530578.612026:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530578.612034:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22759:x1875409555949056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530578.612166:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22759:x1875409555949056:12345-0@lo:502:llog_process_th.0 Request processed in 133us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.612173:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530578.612220:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22759:1875409555949056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530578.612241:0:22759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530578.612244:0:22759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.612246:0:22759:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530578.612250:0:22759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788530578.612352:0:22720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788530578.612361:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788530578.612375:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575202c expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.612588:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f00030400/0xb28d70e125752025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575202c expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530578.612597:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f3b266000 from 1 10000000:01000000:0.0:1788530578.612600:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530578.612625:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.612632:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.612641:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530578.612664:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530578.612689:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.612702:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530578.612807:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949184 00000100:00100000:1.0:1788530578.612811:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949184 00000100:00100000:1.0:1788530578.612839:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530578.612845:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+9:22720:x1875409555949184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530578.612853:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530578.612865:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257520b8 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.612892:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 10 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.612902:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 10 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.612910:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167200, rc 0) 00000100:00100000:1.0:1788530578.612934:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+10:22720:x1875409555949184:12345-0@lo:101:mount.lustre.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.612939:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530578.613149:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530578.613161:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.613170:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530578.613772:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949312:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788530578.613810:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.613831:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.613846:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949312 00000100:00100000:0.0:1788530578.613850:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949312 00000100:00100000:0.0:1788530578.613876:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530578.613882:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+10:22720:x1875409555949312:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788530578.613897:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530578.613901:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788530578.613950:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+10:22720:x1875409555949312:12345-0@lo:256:mount.lustre.0 Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.613957:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530578.613988:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949312:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788530578.614796:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530578.614847:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.614890:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530578.614898:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f3b266000 from 1 10000000:01000000:0.0:1788530578.614901:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530578.614926:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.614933:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.614943:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530578.614956:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530578.614989:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.615016:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.615031:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949440 00000100:00100000:0.0:1788530578.615035:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949440 00000100:00100000:0.0:1788530578.615059:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530578.615065:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+10:22720:x1875409555949440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530578.615073:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530578.615094:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257520c6 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.615112:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 11 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.615141:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 11 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.615149:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2c00, rc 0) 00000100:00100000:0.0:1788530578.615175:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555949440:12345-0@lo:101:mount.lustre.0 Request processed in 111us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.615181:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530578.615213:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530578.615223:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530578.615231:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530578.615257:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530578.615277:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.617824:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.618224:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949568 00000100:00100000:3.0:1788530578.618234:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949568 00000100:00100000:3.0:1788530578.618289:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530578.618298:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555949568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.618478:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555949568:12345-0@lo:501:mount.lustre.0 Request processed in 180us (3198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.618487:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788530578.618707:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530578.618757:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530578.618810:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.618832:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519300 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.619304:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949696 00000100:00100000:0.0:1788530578.619310:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949696 00000100:00100000:0.0:1788530578.619342:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530578.619351:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555949696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530578.619460:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555949696:12345-0@lo:503:mount.lustre.0 Request processed in 110us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.619468:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530578.619731:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555949696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530578.620036:0:22769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22769:1875409555949824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.620068:0:22769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.620103:0:22769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519480 going to sleep for 11 seconds 00000100:00100000:0.0:1788530578.621112:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949824 00000100:00100000:0.0:1788530578.621128:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949824 00000100:00100000:0.0:1788530578.621227:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788530578.621236:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22769:x1875409555949824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530578.621775:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22769:x1875409555949824:12345-0@lo:502:llog_process_th.0 Request processed in 538us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530578.621783:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788530578.621957:0:22769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22769:1875409555949824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530578.621986:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530578.621997:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.621999:0:22769:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788530578.622007:0:22769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f3b266000 00000020:00000080:0.0:1788530578.622010:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530578.622016:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530578.622018:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622019:0:22769:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788530578.622022:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530578.622024:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622025:0:22769:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788530578.622029:0:22769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f3b266000 00000020:00000080:0.0:1788530578.622031:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530578.622235:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530578.622240:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622242:0:22769:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788530578.622244:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530578.622247:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622248:0:22769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788530578.622252:0:22769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f3b266000 00000020:00000080:0.0:1788530578.622254:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530578.622497:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530578.622502:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622503:0:22769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788530578.622506:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530578.622515:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.622516:0:22769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788530578.622520:0:22769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f3b266000 00000020:00000080:0.0:1788530578.622522:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788530578.623172:0:22769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22769:1875409555949952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530578.623227:0:22769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530578.623701:0:22769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18162180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.631337:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555949952 00000100:00100000:3.0:1788530578.631352:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555949952 00000100:00100000:3.0:1788530578.631418:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530578.631429:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22769:x1875409555949952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530578.631610:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22769:x1875409555949952:12345-0@lo:502:llog_process_th.0 Request processed in 183us (8383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.631618:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530578.639459:0:22769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22769:1875409555949952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530578.639500:0:22769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530578.639507:0:22769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530578.639509:0:22769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788530578.639514:0:22769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788530578.642430:0:22720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788530578.642449:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530578.642476:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.642489:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530578.642550:0:22720:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530578.642553:0:22720:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f3b266000 10000000:01000000:3.0:1788530578.642557:0:22720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f3b266000 10000000:01000000:3.0:1788530578.642588:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530578.642609:0:22720:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f3b266000 from 1 10000000:01000000:3.0:1788530578.642612:0:22720:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530578.642644:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.642653:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.642664:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.642695:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530578.642754:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.642788:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768240 going to sleep for 11 seconds 00000100:00100000:2.0:1788530578.649800:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950080 00000100:00100000:2.0:1788530578.649814:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950080 00000100:00100000:2.0:1788530578.649871:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530578.649881:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22720:x1875409555950080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530578.649898:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530578.649915:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141c00/0xb28d70e1257520db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257520d4 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.649942:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141c00/0xb28d70e1257520db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257520d4 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.649953:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141c00/0xb28d70e1257520db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520d4 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.649962:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141c00, rc 0) 00000100:00100000:2.0:1788530578.650028:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950080:12345-0@lo:101:mount.lustre.0 Request processed in 149us (7273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530578.650035:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788530578.651600:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530578.651625:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520db expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.651638:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257520db expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.651692:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.651736:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.651766:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.651783:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950208 00000100:00100000:3.0:1788530578.651787:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950208 00000100:00100000:3.0:1788530578.651823:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530578.651831:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.651937:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950208:12345-0@lo:501:mount.lustre.0 Request processed in 106us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.651944:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530578.651977:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530578.652002:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530578.652036:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.652048:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.652064:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950336 00000100:00100000:3.0:1788530578.652068:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950336 00000100:00100000:3.0:1788530578.652086:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530578.652091:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530578.652174:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950336:12345-0@lo:503:mount.lustre.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.652181:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530578.652223:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530578.654766:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.654840:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.654876:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e025193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.654942:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950464 00000100:00100000:3.0:1788530578.654948:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950464 00000100:00100000:3.0:1788530578.654993:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788530578.655002:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530578.655132:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950464:12345-0@lo:502:llog_process_th.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.655140:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530578.655225:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950464:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788530578.655281:0:22774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788530578.655295:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a9e0377cc98) 00000020:00000080:0.0:1788530578.655311:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788530578.655395:0:22774:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f3b266000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788530578.655399:0:22774:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f3b266000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788530578.655402:0:22774:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f3b266000 4 00010000:00080000:0.0:1788530578.655441:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3d26f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530578.656940:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788530578.657137:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788530578.657171:0:22774:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530578.657184:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb28d70e1257520e9 00000100:00080000:0.0:1788530578.657195:0:22774:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530578.657200:0:22774:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a9f3d26f000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530578.657228:0:22774:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960ea00 x1875409555950592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530578.657257:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788530578.658815:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555950592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530578.658882:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.659001:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950592 00000100:00100000:3.0:1788530578.659009:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950592 00000100:00100000:3.0:1788530578.659048:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530578.659055:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555950592:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788530578.659115:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555950592:12345-0@lo:38:llog_process_th.0 Request processed in 59us (232us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788530578.659131:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530578.664721:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530578.664734:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d26f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530578.664741:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788530578.664746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555950592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530578.670068:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.670258:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.670299:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530578.670320:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950720 00000100:00100000:2.0:1788530578.670326:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950720 00000100:00100000:2.0:1788530578.670372:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530578.670549:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.670714:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950720:12345-0@lo:502:llog_process_th.0 Request processed in 334us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530578.670722:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530578.670770:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.670811:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.670837:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.670849:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530578.670860:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950848 00000100:00100000:2.0:1788530578.670864:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950848 00000100:00100000:2.0:1788530578.670882:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530578.670888:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530578.670940:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22774:x1875409555950848:12345-0@lo:502:llog_process_th.0 Request processed in 51us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530578.670951:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530578.670979:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22774:1875409555950848:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788530578.670998:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788530578.671679:0:22720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788530578.671688:0:22720:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530578.671703:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520db expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.671728:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f00031800/0xb28d70e1257520d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520db expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788530578.671775:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788530578.671777:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530578.671778:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530578.671779:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530578.671781:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530578.671782:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530578.671783:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530578.671785:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530578.671787:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530578.671788:0:22720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530578.671791:0:22720:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788530578.671794:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530578.671795:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530578.671796:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530578.671797:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530578.671798:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530578.671799:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530578.671800:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530578.671801:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530578.671802:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530578.671803:0:22720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530578.671820:0:22720:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788530578.671830:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530578.671862:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.671883:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f05324b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530578.672248:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555950976 00000100:00100000:2.0:1788530578.672254:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555950976 00000100:00100000:2.0:1788530578.672290:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530578.672297:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950976:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788530578.672317:0:22734:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788530578.672330:0:22734:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788530578.674487:0:22734:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788530578.674500:0:22734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788530578.674636:0:22757:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788530578.674641:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788530578.674669:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.674687:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.674695:0:22757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.674729:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530578.674742:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530578.674755:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555951104:0@lo:104: 00000100:00100000:2.0:1788530578.674802:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530578.674870:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530578.675259:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22720:x1875409555950976:12345-0@lo:253:mount.lustre.0 Request processed in 2960us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.675268:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530578.675354:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22720:1875409555950976:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788530578.675365:0:22720:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788530578.675368:0:22720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530578.675369:0:22720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788530578.675371:0:22720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530578.675372:0:22720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530578.675373:0:22720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530578.675374:0:22720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530578.675376:0:22720:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530578.675377:0:22720:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788530578.675379:0:22720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530578.675390:0:22720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788530578.675402:0:22720:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788530578.676637:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951104 00000100:00100000:1.0:1788530578.676646:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951104 00000100:00100000:1.0:1788530578.676714:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530578.676723:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555951104:12345-0@lo:104: 00010000:00010000:1.0:1788530578.676738:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530578.676802:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530578.676807:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555951104:12345-0@lo:104: Request processed in 86us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530578.676813:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530578.676876:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555951104:0@lo:104: 00010000:00010000:0.0:1788530578.676897:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691456:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530578.691469:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691481:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3e00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530578.691485:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691496:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530578.691503:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530578.691509:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530578.691551:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691572:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530578.691592:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691600:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3e00/0xb28d70e1257520b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520bf expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691618:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.691620:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530578.691622:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530578.691658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555951232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530578.691715:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530578.691797:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951232 00000100:00100000:3.0:1788530578.691804:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951232 00010000:00010000:3.0:1788530578.691827:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530578.691851:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530578.691860:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3650:x1875409555951232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530578.691872:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530578.691877:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691888:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691901:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167200/0xb28d70e1257520bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257520b8 expref: 12 pid: 22733 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691916:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691924:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788530578.691938:0:22726:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017298453s 00010000:00010000:3.0:1788530578.691942:0:22726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691949:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691956:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691967:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691973:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530578.691977:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691984:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.691999:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.692008:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530578.692041:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:3650:x1875409555951232:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530578.692049:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530578.692102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555951232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530578.692132:0:22757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.692141:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530578.692147:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257520f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788530578.710925:0:22720:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788530578.715711:0:22720:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788530578.715839:0:22780:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1788530578.715843:0:22780:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:1.0:1788530578.718083:0:22781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788530578.718236:0:22720:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788530578.718733:0:22782:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a9f32bd2680 x1875409555951360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530578.718744:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00000040:01000000:3.0:1788530578.719020:0:22720:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788530578.719057:0:22720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788530578.719671:0:22720:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788530578.719678:0:22720:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788530578.719711:0:22720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530578.721176:0:22720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788530578.721630:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530578.722003:0:22720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788530578.722037:0:22720:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788530578.723737:0:22781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788530578.723799:0:22781:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788530578.724771:0:22720:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788530578.725305:0:22720:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788530578.745444:0:22720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788530578.752891:0:22720:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788530578.752930:0:22720:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb378019579b8 00100000:10000000:2.0:1788530578.752938:0:22720:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788530578.754248:0:22720:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788530578.754267:0:22720:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788530578.756778:0:22720:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530578.756979:0:22720:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530579.405774:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530579.713439:0:22776:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788530579.713449:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530579.715311:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788530579.715322:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788530579.779032:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 10000000:01000000:0.0:1788530579.854269:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530579.854278:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f3b266000 from 11 10000000:01000000:0.0:1788530579.854283:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530579.854332:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854343:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854354:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530579.854380:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555951488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530579.854449:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530579.854489:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951488 00000100:00100000:0.0:1788530579.854496:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951488 00000100:00100000:0.0:1788530579.854550:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530579.854576:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+11:22738:x1875409555951488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530579.854591:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530579.854605:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257520f7 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854646:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854659:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854667:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3800, rc 0) 00000100:00100000:0.0:1788530579.854699:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22738:x1875409555951488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530579.854707:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530579.854750:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788530579.854770:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555951488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530579.854784:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530579.854793:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530579.854840:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555951616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530579.854869:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530579.854891:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951616 00000100:00100000:0.0:1788530579.854895:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951616 00000100:00100000:0.0:1788530579.854918:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530579.854924:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22738:x1875409555951616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530579.854936:0:22734:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:1.0:1788530579.856145:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a240 going to sleep for 11 seconds 20000000:01000000:0.0:1788530579.857446:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530579.857459:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788530579.857606:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:22738:x1875409555951616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2679us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530579.857617:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530579.858256:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555951616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788530579.858315:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530579.858324:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530579.858333:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530580.417674:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530580.736775:0:22776:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788530580.736784:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530580.737165:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788530580.737204:0:22776:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530580.737346:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788530580.800639:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:1.0:1788530581.442224:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530581.830677:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530582.464672:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530582.858380:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:3.0:1788530583.493957:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530583.595794:0:23023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788530583.890934:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00000100:00080000:0.0:1788530584.134310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530584.134317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788530584.134320:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530584.134336:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:0.0:1788530584.134342:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788530584.134348:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e01aa3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530584.134371:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960c000 x1875409555951872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530584.134385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530584.134389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530584.134392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530584.134395:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530584.134398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530584.134400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788530584.134402:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d26f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530584.134406:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a9f3d26f000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530584.134418:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960d880 x1875409555952000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530584.134729:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555951744:0@lo:400:kworker.0 00000100:00100000:2.0:1788530584.134816:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530584.134890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555951872:0@lo:38:kworker.0 00000100:00100000:2.0:1788530584.134973:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530584.134994:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555952000:0@lo:38:kworker.0 00000100:00100000:2.0:1788530584.135032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530584.135081:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951872 00000100:00100000:2.0:1788530584.135089:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951872 00000100:00100000:2.0:1788530584.135128:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530584.135136:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555951872:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788530584.135155:0:22747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788530584.135194:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555951872:12345-0@lo:38:kworker.0 Request processed in 57us (221us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530584.135201:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788530584.135235:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530584.135239:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530584.135243:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555951872:0@lo:38:kworker.0 00000100:00100000:0.0:1788530584.135825:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951744 00000100:00100000:0.0:1788530584.135831:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951744 00000100:00100000:0.0:1788530584.135871:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530584.135878:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3647:x1875409555951744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530584.135924:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3647:x1875409555951744:12345-0@lo:400:kworker.0 Request processed in 46us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530584.135931:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530584.135972:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952000 00000100:00100000:0.0:1788530584.135976:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952000 00000100:00100000:0.0:1788530584.135995:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530584.135999:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555952000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788530584.136018:0:22743:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 792 last 0 00000020:00000080:0.0:1788530584.136053:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb28d70e125752105 00000004:00100000:0.0:1788530584.136082:0:22743:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530584.136218:0:22743:0:(import.c:65:import_set_state_nolock()) ffff9a9f2b9ba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530584.136254:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875409555952000:12345-0@lo:38:kworker.0 Request processed in 252us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530584.136260:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530584.138145:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555951744:0@lo:400:kworker.0 00010000:00080000:2.0:1788530584.138207:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9f3960d880 x1875409555952000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530584.138223:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788530584.138237:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788530584.138242:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788530584.138245:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d26f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788530584.138251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555952000:0@lo:38:kworker.0 00010000:00010000:0.0:1788530584.512723:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530584.690200:0:23077:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530584.690410:0:23077:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530584.910967:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:3.0:1788530585.536878:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530585.741754:0:23127:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530585.741929:0:23127:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530585.923611:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530586.565436:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530586.947725:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:3.0:1788530587.595668:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530587.970962:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00000100:00100000:0.0:1788530588.224774:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530578/real 1788530578] req@ffff9a9e0375d880 x1875409555948928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530588.224804:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375d880 x1875409555948928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530588.224829:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530578/real 1788530578] req@ffff9a9e0375c000 x1875409555948800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530588.224842:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375c000 x1875409555948800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530588.224858:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530588.224873:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530588.224877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948928:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788530588.224882:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530588.224886:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530588.224889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555948800:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788530588.226054:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788530588.226060:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788530588.226063:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530588.226069:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 792 00000100:00080000:3.0:1788530588.226082:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788530588.226088:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e01aa3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530588.226112:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df92a00 x1875409555952256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530588.226128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530588.226132:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788530588.226133:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530588.226137:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:3.0:1788530588.226139:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788530588.226142:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e01aa1000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530588.226153:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df91500 x1875409555952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530588.226162:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530588.226165:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530588.226166:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530588.226169:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:3.0:1788530588.226171:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788530588.226175:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530588.226186:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df93800 x1875409555952512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530588.226225:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952256:0@lo:38:kworker.0 00000100:00100000:3.0:1788530588.226294:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530588.226340:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952384:0@lo:8:kworker.0 00000400:00000100:3.0:1788530588.226361:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555952384 offset 0 length 520: 4 00000100:00100000:3.0:1788530588.226387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952512:0@lo:8:kworker.0 00000400:00000100:3.0:1788530588.226420:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555952512 offset 0 length 520: 4 00000100:00100000:3.0:1788530588.226448:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555952640:0@lo:400:kworker.0 00000100:00100000:3.0:1788530588.226491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530588.228578:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555952128:0@lo:400:kworker.0 00000100:00100000:2.0:1788530588.231440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530588.231534:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952256 00000100:00100000:2.0:1788530588.231544:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952256 00000100:00100000:2.0:1788530588.231610:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530588.231618:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555952256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788530588.231992:0:22747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788530588.232074:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555952256:12345-0@lo:38:kworker.0 Request processed in 455us (5779us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530588.232083:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530588.232121:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952640 00000100:00100000:2.0:1788530588.232126:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952640 00000100:00100000:2.0:1788530588.232160:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530588.232167:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530588.232216:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555952640:12345-0@lo:400:kworker.0 Request processed in 50us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530588.232224:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530588.232514:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952128 00000100:00100000:3.0:1788530588.232519:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952128 00000100:00100000:3.0:1788530588.232555:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530588.232582:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3648:x1875409555952128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530588.232625:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3648:x1875409555952128:12345-0@lo:400:kworker.0 Request processed in 63us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530588.233799:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788530588.233871:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9f3df91880 x1875409555952640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530588.233889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555952640:0@lo:400:kworker.0 00000100:00080000:1.0:1788530588.234121:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530588.234126:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530588.234130:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952256:0@lo:38:kworker.0 00000100:00100000:2.0:1788530588.236472:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555952128:0@lo:400:kworker.0 00010000:00010000:0.0:1788530588.609518:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530588.993160:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:3.0:1788530589.634734:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530590.017894:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530590.657696:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530590.993988:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530591.046903:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:3.0:1788530591.684428:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530592.064647:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530592.708093:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530593.097281:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00000100:00080000:0.0:1788530593.345926:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530593.345933:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788530593.345937:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530593.345946:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 796 00000100:00080000:0.0:1788530593.345952:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788530593.345959:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e01aa3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530593.345989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555952768:0@lo:400:kworker.0 00000100:00100000:0.0:1788530593.345990:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960e680 x1875409555952896/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530593.346008:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530593.346011:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530593.346023:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530593.346026:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530593.346064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952896:0@lo:38:kworker.0 00000100:00100000:3.0:1788530593.346095:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.346095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.346315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555953024:0@lo:400:kworker.0 00000100:00100000:0.0:1788530593.346348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.346403:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952896 00000100:00100000:0.0:1788530593.346411:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952896 00000100:00100000:0.0:1788530593.346444:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530593.346452:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555952896:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788530593.346469:0:22747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788530593.346509:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555952896:12345-0@lo:38:kworker.0 Request processed in 56us (413us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788530593.346516:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788530593.346552:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530593.346557:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530593.346582:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952896:0@lo:38:kworker.0 00000100:00100000:2.0:1788530593.347113:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953024 00000100:00100000:2.0:1788530593.347119:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953024 00000100:00100000:2.0:1788530593.347170:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530593.347179:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555953024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530593.347233:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555953024:12345-0@lo:400:kworker.0 Request processed in 56us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.347254:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530593.349779:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555952768 00000100:00100000:3.0:1788530593.349795:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555952768 00000100:00100000:3.0:1788530593.349874:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530593.349895:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3650:x1875409555952768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530593.349994:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:3650:x1875409555952768:12345-0@lo:400:kworker.0 Request processed in 102us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.350009:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530593.350071:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555952768:0@lo:400:kworker.0 00010000:00080000:0.0:1788530593.350973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9f3960f480 x1875409555953024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530593.350999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555953024:0@lo:400:kworker.0 00000020:01000004:1.0:1788530593.383311:0:23472:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788530593.383316:0:23472:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788530593.383317:0:23472:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788530593.383442:0:23472:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9e03d6c000 00000020:01000004:1.0:1788530593.383458:0:23472:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788530593.383469:0:23472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788530593.383481:0:23472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a9f04531988) 00000020:00000080:1.0:1788530593.383498:0:23472:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788530593.467078:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788530593.467883:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.470120:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.470359:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.470543:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.470968:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.471412:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.471634:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.473929:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.474499:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.474950:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.475343:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.475583:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.475956:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.476266:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.476501:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.476965:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.477201:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.477511:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.479592:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.480155:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.480435:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.480819:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788530593.481145:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.481363:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.481942:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788530593.482252:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788530593.490936:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788530593.491594:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788530593.492027:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788530593.492310:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788530593.492493:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788530593.493336:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788530593.493638:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788530593.500006:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788530593.502800:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788530593.504641:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788530593.505233:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788530593.505489:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788530593.509521:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788530593.510031:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788530593.510297:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788530593.510495:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788530593.510889:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788530593.511314:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788530593.512375:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788530593.515054:0:23472:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788530593.515310:0:23472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788530593.515322:0:23472:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788530593.515334:0:23472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125752113 00000020:01000004:1.0:1788530593.515341:0:23472:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788530593.515362:0:23472:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788530593.515365:0:23472:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788530593.515382:0:23472:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788530593.515412:0:23472:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788530593.515417:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788530593.515418:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788530593.515419:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530593.515420:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530593.515422:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530593.515423:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530593.515424:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530593.515426:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530593.515428:0:23472:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530593.515430:0:23472:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788530593.515433:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530593.515434:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788530593.515435:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530593.515436:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530593.515438:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530593.515439:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530593.515440:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530593.515441:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530593.515442:0:23472:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530593.515468:0:23472:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788530593.515490:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530593.515592:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.515652:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03f7dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530593.517157:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953152 00000100:00100000:0.0:1788530593.517170:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953152 00000100:00100000:0.0:1788530593.517251:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530593.517262:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:23472:x1875409555953152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788530593.517298:0:22736:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788530593.517301:0:22736:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788530593.517308:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788530593.518164:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:23472:x1875409555953152:12345-0@lo:253:mount.lustre.0 Request processed in 901us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530593.518175:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788530593.518511:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788530593.518524:0:23472:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788530593.518528:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788530593.518529:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788530593.518530:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530593.518532:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530593.518532:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530593.518534:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530593.518535:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530593.518537:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530593.518538:0:23472:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788530593.518587:0:23472:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9e03d6c000 from lustre-MDT0001 10000000:01000000:1.0:1788530593.518619:0:23472:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788530593.518621:0:23472:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788530593.518626:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9e03d6c000 10000000:01000000:1.0:1788530593.518630:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530593.518650:0:23472:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788530593.520638:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530593.523853:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530593.523868:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9e03d6c000 from 1 10000000:01000000:1.0:1788530593.523871:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530593.523911:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.523922:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.523933:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.525236:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530593.525326:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.525382:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.525852:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953280 00000100:00100000:2.0:1788530593.525861:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953280 00000100:00100000:2.0:1788530593.525920:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788530593.525930:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+12:23472:x1875409555953280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530593.525945:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530593.525991:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140e00/0xb28d70e125752121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575211a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.526022:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140e00/0xb28d70e125752121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575211a expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.526034:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140e00/0xb28d70e125752121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575211a expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.526043:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00000100:00100000:2.0:1788530593.526096:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953280:12345-0@lo:101:mount.lustre.0 Request processed in 167us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.526103:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788530593.528027:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530593.528055:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752121 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.528067:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752121 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.528168:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530593.528221:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.528395:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953408 00000100:00100000:0.0:1788530593.528402:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953408 00000100:00100000:0.0:1788530593.528445:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530593.528452:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530593.528513:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953408:12345-0@lo:501:mount.lustre.0 Request processed in 61us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530593.528520:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530593.528913:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530593.528928:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953408:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530593.528942:0:23472:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788530593.528990:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530593.529016:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.529083:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.538514:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953536 00000100:00100000:3.0:1788530593.538530:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953536 00000100:00100000:2.0:1788530593.538820:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530593.538833:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530593.541504:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953536:12345-0@lo:501:mount.lustre.0 Request processed in 2665us (12477us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530593.541520:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530593.542217:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530593.542271:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530593.542299:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752121 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.542312:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e12575211a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752121 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530593.542323:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9e03d6c000 10000000:01000000:1.0:1788530593.542329:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788530593.542373:0:23472:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788530593.542476:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530593.542484:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530593.542492:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff9a9e03779988 10000000:01000000:1.0:1788530593.542496:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788530593.542520:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log nodemap-ffff9a9e03779988 from 1 10000000:01000000:1.0:1788530593.542523:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788530593.542578:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.542587:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.542599:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.542620:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530593.542676:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.542826:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953664 00000100:00100000:3.0:1788530593.542833:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953664 00000100:00100000:3.0:1788530593.542885:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530593.542896:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+13:23472:x1875409555953664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530593.542911:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530593.542924:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f00030000/0xb28d70e12575212f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752128 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.543026:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639300 going to sleep for 11 seconds 00010000:00010000:3.0:1788530593.543121:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f00030000/0xb28d70e12575212f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752128 expref: 14 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.543134:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f00030000/0xb28d70e12575212f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752128 expref: 14 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.543144:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030000, rc 0) 00000100:00100000:3.0:1788530593.543198:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+14:23472:x1875409555953664:12345-0@lo:101:mount.lustre.0 Request processed in 304us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.543205:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530593.543610:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530593.543625:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575212f expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.543637:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575212f expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530593.543654:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788530593.543670:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575212f expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.543678:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125752128 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575212f expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530593.543699:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9e03d6c000 10000000:01000000:1.0:1788530593.543703:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788530593.543741:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9e03d6c000 from 1 10000000:01000000:1.0:1788530593.543744:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788530593.543765:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.543772:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.543779:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.543793:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530593.543824:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.543849:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.544135:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953792 00000100:00100000:3.0:1788530593.544140:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953792 00000100:00100000:3.0:1788530593.544183:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530593.544192:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+14:23472:x1875409555953792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530593.544202:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530593.544219:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f00030e00/0xb28d70e12575213d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752136 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.544235:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f00030e00/0xb28d70e12575213d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752136 expref: 15 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.544256:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f00030e00/0xb28d70e12575213d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752136 expref: 15 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.544265:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030e00, rc 0) 00000100:00100000:3.0:1788530593.544303:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+15:23472:x1875409555953792:12345-0@lo:101:mount.lustre.0 Request processed in 113us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.544309:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530593.544443:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530593.544464:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575213d expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.544471:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575213d expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530593.544484:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788530593.544501:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575213d expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.544508:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125752136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575213d expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530593.544515:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788530593.544520:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530593.544541:0:23472:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788530593.544661:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530593.544670:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530593.544677:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9e03d6c000 10000000:01000000:2.0:1788530593.544682:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788530593.544704:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788530593.544707:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788530593.544729:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.544735:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.544743:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530593.544769:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530593.544799:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.544817:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.544936:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555953920 00000100:00100000:3.0:1788530593.544941:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555953920 00000100:00100000:3.0:1788530593.545079:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530593.545087:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+15:23472:x1875409555953920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530593.545096:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530593.545106:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f00030200/0xb28d70e12575214b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752144 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.545121:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f00030200/0xb28d70e12575214b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752144 expref: 16 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.545130:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f00030200/0xb28d70e12575214b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752144 expref: 16 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.545138:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030200, rc 0) 00000100:00100000:3.0:1788530593.545180:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555953920:12345-0@lo:101:mount.lustre.0 Request processed in 94us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.545196:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530593.545282:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555953920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530593.545295:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575214b expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.545309:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575214b expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530593.547186:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 46 count 46 00000040:00080000:0.0:1788530593.547825:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530593.556910:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1788530593.557324:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 136 off8552 00000040:00080000:0.0:1788530593.557347:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 176 off8728 00000040:00080000:0.0:1788530593.557363:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8952 00000040:00080000:0.0:1788530593.557377:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 224 off9176 00000040:00080000:0.0:1788530593.557394:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 120 off9296 00000040:00080000:0.0:1788530593.557410:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 112 off9408 00000040:00080000:0.0:1788530593.557424:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 160 off9568 00000040:00080000:0.0:1788530593.557439:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9792 00000040:00080000:0.0:1788530593.557452:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10016 00000040:00080000:0.0:1788530593.557468:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 88 off10104 00000040:00080000:0.0:1788530593.557482:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 144 off10248 00000040:00080000:0.0:1788530593.557497:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].13, 152 off10400 00000040:00080000:0.0:1788530593.557510:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].14, 168 off10568 00000040:00080000:0.0:1788530593.557524:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].15, 224 off10792 00000040:00080000:0.0:1788530593.557537:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].16, 224 off11016 00000040:00080000:0.0:1788530593.557551:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].17, 80 off11096 00000040:00080000:0.0:1788530593.557639:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].18, 224 off11320 00000040:00080000:0.0:1788530593.557657:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].19, 224 off11544 00000040:00080000:0.0:1788530593.557673:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].20, 160 off11704 00000040:00080000:0.0:1788530593.557692:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].21, 224 off11928 00000040:00080000:0.0:1788530593.557708:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].22, 224 off12152 00000040:00080000:0.0:1788530593.557723:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].23, 80 off12232 00000040:00080000:0.0:1788530593.557738:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].24, 224 off12456 00000040:00080000:0.0:1788530593.557752:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].25, 224 off12680 00000040:00080000:0.0:1788530593.557778:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].26, 88 off12768 00000040:00080000:0.0:1788530593.557794:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].27, 144 off12912 00000040:00080000:0.0:1788530593.557806:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].28, 152 off13064 00000040:00080000:0.0:1788530593.557817:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].29, 136 off13200 00000040:00080000:0.0:1788530593.557828:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].30, 224 off13424 00000040:00080000:0.0:1788530593.557841:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].31, 224 off13648 00000040:00080000:0.0:1788530593.557851:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].32, 80 off13728 00000040:00080000:0.0:1788530593.557862:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].33, 224 off13952 00000040:00080000:0.0:1788530593.557873:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].34, 224 off14176 00000040:00080000:0.0:1788530593.557886:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].35, 88 off14264 00000040:00080000:0.0:1788530593.557900:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].36, 144 off14408 00000040:00080000:0.0:1788530593.557914:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].37, 152 off14560 00000040:00080000:0.0:1788530593.557927:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].38, 136 off14696 00000040:00080000:0.0:1788530593.557942:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].39, 224 off14920 00000040:00080000:0.0:1788530593.558400:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].40, 224 off15144 00000040:00080000:0.0:1788530593.558418:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].41, 80 off15224 00000040:00080000:0.0:1788530593.558432:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].42, 224 off15448 00000040:00080000:0.0:1788530593.558445:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].43, 224 off15672 00000040:00080000:0.0:1788530593.558458:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].44, 120 off15792 00000040:00080000:0.0:1788530593.558488:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].45, 224 off16016 00000040:00080000:0.0:1788530593.558493:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 45 count 46 00000100:00100000:0.0:1788530593.558637:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530593.558700:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.558743:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.558885:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954048 00000100:00100000:3.0:1788530593.558893:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954048 00000100:00100000:3.0:1788530593.558942:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788530593.558965:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530593.559132:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954048:12345-0@lo:501:mount.lustre.0 Request processed in 170us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.559141:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530593.559295:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530593.559348:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530593.559385:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.559414:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530593.559518:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954176 00000100:00100000:1.0:1788530593.559523:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954176 00000100:00100000:1.0:1788530593.559580:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530593.559588:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530593.560898:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954176:12345-0@lo:503:mount.lustre.0 Request processed in 1305us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.560909:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530593.561109:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530593.561691:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530593.561793:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.561845:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.561889:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.562257:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954304 00000100:00100000:3.0:1788530593.562264:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954304 00000100:00100000:3.0:1788530593.562311:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788530593.562321:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530593.563344:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954304:12345-0@lo:502:mount.lustre.0 Request processed in 1020us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.563355:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530593.563503:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530593.563757:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:2.0:1788530593.563786:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 136 off8552 00000040:00080000:2.0:1788530593.563800:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 176 off8728 00000040:00080000:2.0:1788530593.563811:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8952 00000040:00080000:2.0:1788530593.563822:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 224 off9176 00000040:00080000:2.0:1788530593.563833:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 120 off9296 00000040:00080000:2.0:1788530593.563845:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 112 off9408 00000040:00080000:2.0:1788530593.563857:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 160 off9568 00000040:00080000:2.0:1788530593.563868:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9792 00000040:00080000:2.0:1788530593.563880:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10016 00000040:00080000:2.0:1788530593.563891:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 88 off10104 00000040:00080000:2.0:1788530593.563904:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 144 off10248 00000040:00080000:2.0:1788530593.563927:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].13, 152 off10400 00000040:00080000:2.0:1788530593.563940:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].14, 168 off10568 00000040:00080000:2.0:1788530593.563970:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].15, 224 off10792 00000040:00080000:2.0:1788530593.564000:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].16, 224 off11016 00000040:00080000:2.0:1788530593.564012:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].17, 80 off11096 00000040:00080000:2.0:1788530593.564022:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].18, 224 off11320 00000040:00080000:2.0:1788530593.564032:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].19, 224 off11544 00000040:00080000:2.0:1788530593.564044:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].20, 160 off11704 00000040:00080000:2.0:1788530593.564055:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].21, 224 off11928 00000040:00080000:2.0:1788530593.564067:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].22, 224 off12152 00000040:00080000:2.0:1788530593.564078:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].23, 80 off12232 00000040:00080000:2.0:1788530593.564091:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].24, 224 off12456 00000040:00080000:2.0:1788530593.564103:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].25, 224 off12680 00000040:00080000:2.0:1788530593.564118:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].26, 88 off12768 00000040:00080000:2.0:1788530593.564131:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].27, 144 off12912 00000040:00080000:2.0:1788530593.564144:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].28, 152 off13064 00000040:00080000:2.0:1788530593.564156:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].29, 136 off13200 00000040:00080000:2.0:1788530593.564170:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].30, 224 off13424 00000040:00080000:2.0:1788530593.564184:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].31, 224 off13648 00000040:00080000:2.0:1788530593.564196:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].32, 80 off13728 00000040:00080000:2.0:1788530593.564208:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].33, 224 off13952 00000040:00080000:2.0:1788530593.564222:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].34, 224 off14176 00000040:00080000:2.0:1788530593.564234:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].35, 88 off14264 00000040:00080000:2.0:1788530593.564260:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].36, 144 off14408 00000040:00080000:2.0:1788530593.564274:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].37, 152 off14560 00000040:00080000:2.0:1788530593.564287:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].38, 136 off14696 00000040:00080000:2.0:1788530593.564301:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].39, 224 off14920 00000040:00080000:2.0:1788530593.564313:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].40, 224 off15144 00000040:00080000:2.0:1788530593.564325:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].41, 80 off15224 00000040:00080000:2.0:1788530593.564336:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].42, 224 off15448 00000040:00080000:2.0:1788530593.564348:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].43, 224 off15672 00000040:00080000:2.0:1788530593.564361:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].44, 120 off15792 00000100:00100000:2.0:1788530593.564395:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.564454:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.564486:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530593.564739:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954432 00000100:00100000:1.0:1788530593.564746:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954432 00000100:00100000:1.0:1788530593.564783:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530593.564791:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530593.564897:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555954432:12345-0@lo:502:mount.lustre.0 Request processed in 106us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.564905:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788530593.565415:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555954432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530593.565476:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].45, 224 off16016 00000040:00080000:3.0:1788530593.565487:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788530593.566343:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.566355:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.566357:0:23476:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788530593.566362:0:23476:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788530593.566365:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530593.566380:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a9f39656620) 00000020:00000080:3.0:1788530593.566400:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788530593.566407:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788530593.566479:0:23476:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788530593.566494:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125752159 00000020:00000080:3.0:1788530593.566908:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788530593.566913:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.566917:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.566918:0:23476:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788530593.566921:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.566925:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.566926:0:23476:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788530593.566929:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530593.566938:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a9f3d214c98) 00000020:00000080:3.0:1788530593.567356:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788530593.567365:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788530593.567367:0:23476:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788530593.567369:0:23476:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788530593.567376:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788530593.567449:0:23476:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e03d6c000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788530593.567464:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a9f3d216620) 00000020:00000080:3.0:1788530593.567474:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788530593.567535:0:23476:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788530593.567541:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e12575216e 00000020:00000080:3.0:1788530593.567825:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788530593.567832:0:23476:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788530593.567837:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb28d70e125752175 00080000:01000000:3.0:1788530593.567844:0:23476:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788530593.567848:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575217c 00010000:00010000:2.0:1788530593.697781:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788530593.698599:0:23476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788530593.699375:0:23476:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788530593.705873:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788530593.705891:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.705902:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.705904:0:23476:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788530593.705908:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.705916:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.705917:0:23476:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788530593.705921:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788530593.705927:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:3.0:1788530593.705986:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530593.706005:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a9f3d211988) 00000020:00000080:3.0:1788530593.706032:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788530593.706039:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788530593.706136:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788530593.706143:0:23476:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788530593.706150:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575218a 00010000:00080000:3.0:1788530593.706185:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3288b000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530593.710490:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788530593.712394:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788530593.712407:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788530593.712443:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788530593.712462:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125752191 00000100:00080000:0.0:1788530593.712472:0:23476:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530593.712478:0:23476:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f3288b000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530593.712512:0:23476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960e680 x1875409555954560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530593.712546:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788530593.712593:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530593.712598:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530593.712601:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530593.712604:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788530593.712669:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530593.712672:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712674:0:23476:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788530593.712677:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530593.712679:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788530593.712681:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530593.712682:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530593.712684:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788530593.712685:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712687:0:23476:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530593.712689:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530593.712692:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712693:0:23476:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788530593.712696:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788530593.712724:0:23476:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788530593.712738:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530593.712741:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712742:0:23476:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788530593.712744:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530593.712746:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788530593.712747:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530593.712748:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530593.712750:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788530593.712752:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712753:0:23476:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530593.712760:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788530593.712764:0:23476:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788530593.712767:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530593.712768:0:23476:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788530593.712770:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788530593.712774:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:0.0:1788530593.712796:0:23476:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788530593.712799:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530593.712810:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a9e0377e620) 00000020:00000080:0.0:1788530593.712823:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788530593.712827:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788530593.712882:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788530593.712888:0:23476:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788530593.712892:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575219f 00010000:00080000:0.0:1788530593.712919:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f0aaed000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530593.713135:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788530593.713605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530593.713682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.714180:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954560 00000100:00100000:0.0:1788530593.714189:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954560 00000100:00100000:0.0:1788530593.714322:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530593.714332:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555954560:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788530593.718445:0:22747:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:1.0:1788530593.718495:0:22747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257521a6 00000004:00100000:1.0:1788530593.718513:0:22747:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788530593.718520:0:22747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1788530593.719089:0:23476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788530593.720187:0:23476:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788530593.724554:0:23476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788530593.725292:0:22747:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530593.725405:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555954560:12345-0@lo:38:llog_process_th.0 Request processed in 11070us (11721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.725421:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788530593.725745:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788530593.725909:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788530593.726318:0:23481:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788530593.726323:0:23481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788530593.727551:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530593.727609:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788530593.727654:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788530593.727676:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257521ad 00000100:00080000:1.0:1788530593.727686:0:23476:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530593.727691:0:23476:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f0aaed000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530593.727724:0:23476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375f100 x1875409555954688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530593.727741:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788530593.727799:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530593.727803:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530593.727805:0:23476:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788530593.727807:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788530593.727810:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788530593.727812:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530593.727813:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788530593.727825:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788530593.727827:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530593.727829:0:23476:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788530593.727831:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788530593.727835:0:23476:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788530593.727839:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530593.727840:0:23476:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788530593.727843:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788530593.727846:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:1.0:1788530593.727873:0:23476:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788530593.727876:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530593.727889:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a9f2c149988) 00000020:00000080:1.0:1788530593.727902:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788530593.727907:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788530593.727970:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788530593.727988:0:23476:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788530593.727997:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e1257521bb 00010000:00080000:1.0:1788530593.728027:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3b05a000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530593.728242:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788530593.728312:0:23476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788530593.728325:0:23476:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788530593.732141:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530593.732151:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530593.732154:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530593.732156:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530593.732759:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954688:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788530593.732827:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555954688 offset 0 length 520: 4 00000100:00100000:0.0:1788530593.732884:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530593.732896:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788530593.732904:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788530593.732910:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788530593.732913:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3288b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788530593.732940:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954560:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788530593.733165:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530593.733658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530593.733670:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555954816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530593.734054:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.734085:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555954816 00000100:00100000:3.0:1788530593.734092:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555954816 00000100:00100000:3.0:1788530593.734143:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530593.734154:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555954816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530593.734190:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530593.734273:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555954816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.734280:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1788530593.734392:0:23476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530593.734451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555954816:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788530593.734639:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788530593.734832:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788530593.735394:0:23483:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788530593.735399:0:23483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788530593.736088:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788530593.736101:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788530593.736150:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788530593.736171:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257521c2 00000100:00080000:2.0:1788530593.736181:0:23476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530593.736186:0:23476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530593.736215:0:23476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f32bd0a80 x1875409555954944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530593.736254:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788530593.736316:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530593.736321:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530593.736322:0:23476:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788530593.736326:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530593.736329:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530593.736330:0:23476:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530593.736333:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530593.736335:0:23476:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788530593.736337:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530593.736340:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530593.736341:0:23476:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788530593.736343:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530593.736346:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530593.736347:0:23476:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788530593.736351:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788530593.736374:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530593.736377:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530593.736378:0:23476:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788530593.736381:0:23476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000020:01000000:2.0:1788530593.736434:0:23472:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788530593.736446:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788530593.736459:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575214b expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.736470:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140c00/0xb28d70e125752144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575214b expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530593.736485:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03d6c000 from 1 10000000:01000000:2.0:1788530593.736488:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530593.736511:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.736519:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.736531:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530593.736549:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955072:0@lo:101:mount.lustre.0 00000100:00080000:3.0:1788530593.736603:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530593.736608:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530593.736610:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530593.736613:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788530593.736634:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.736653:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955072 00000100:00100000:3.0:1788530593.736659:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955072 00000100:00100000:2.0:1788530593.736663:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.736693:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530593.736702:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+16:23472:x1875409555955072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530593.736714:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530593.736727:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257521c9 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.736753:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 17 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.736764:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 17 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530593.736772:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030c00, rc 0) 00000100:00100000:3.0:1788530593.736812:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:23472:x1875409555955072:12345-0@lo:101:mount.lustre.0 Request processed in 111us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.736820:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530593.737003:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530593.737017:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.737026:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530593.737344:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954944:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788530593.737374:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555954944 offset 0 length 520: 4 00000100:00100000:2.0:1788530593.737524:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955200:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788530593.737590:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.737618:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.737630:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955200 00000100:00100000:3.0:1788530593.737634:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955200 00000100:00100000:3.0:1788530593.737669:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530593.737676:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:23472:x1875409555955200:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788530593.737691:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788530593.737709:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530593.737712:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788530593.737794:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:23472:x1875409555955200:12345-0@lo:256:mount.lustre.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.737801:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530593.738300:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955200:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788530593.738878:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530593.738891:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.738901:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530593.738909:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03d6c000 from 1 10000000:01000000:0.0:1788530593.738912:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530593.738944:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.739110:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.739121:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530593.739139:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530593.739186:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.739220:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530593.739294:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955328 00000100:00100000:1.0:1788530593.739300:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955328 00000100:00100000:1.0:1788530593.739354:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530593.739364:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:23472:x1875409555955328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530593.739375:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530593.739387:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257521d7 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.739408:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.739431:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.739439:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167c00, rc 0) 00000100:00100000:1.0:1788530593.739482:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955328:12345-0@lo:101:mount.lustre.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.739489:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530593.739584:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530593.739605:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.739615:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530593.746104:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 13 count 13 00000040:00080000:1.0:1788530593.746427:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530593.746678:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1788530593.746705:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 112 off8528 00000040:00080000:1.0:1788530593.746720:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 224 off8752 00000040:00080000:1.0:1788530593.746734:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8976 00000040:00080000:1.0:1788530593.746747:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 112 off9088 00000040:00080000:1.0:1788530593.746760:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 224 off9312 00000040:00080000:1.0:1788530593.746771:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 224 off9536 00000040:00080000:1.0:1788530593.746781:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 128 off9664 00000040:00080000:1.0:1788530593.746793:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:1.0:1788530593.746804:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 224 off10112 00000040:00080000:1.0:1788530593.746816:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 128 off10240 00000040:00080000:1.0:1788530593.746832:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10464 00000040:00080000:1.0:1788530593.746837:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 12 count 13 00000100:00100000:1.0:1788530593.746909:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530593.746998:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.747039:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.747285:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955456 00000100:00100000:2.0:1788530593.747294:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955456 00000100:00100000:2.0:1788530593.747343:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530593.747362:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530593.747489:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955456:12345-0@lo:501:mount.lustre.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.747496:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788530593.747773:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530593.747818:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530593.747860:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.747889:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.751304:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955584 00000100:00100000:2.0:1788530593.751320:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955584 00000100:00100000:2.0:1788530593.751387:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530593.751396:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530593.751589:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955584:12345-0@lo:503:mount.lustre.0 Request processed in 167us (3701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.751598:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530593.751787:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788530593.752300:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530593.752388:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530593.752449:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.752500:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.752728:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955712 00000100:00100000:2.0:1788530593.752734:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955712 00000100:00100000:2.0:1788530593.752776:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530593.752784:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.752874:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955712:12345-0@lo:502:mount.lustre.0 Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.752882:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530593.753071:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530593.753243:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:1.0:1788530593.753286:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 112 off8528 00000040:00080000:1.0:1788530593.753303:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 224 off8752 00000040:00080000:1.0:1788530593.753318:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8976 00000040:00080000:1.0:1788530593.753329:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 112 off9088 00000040:00080000:1.0:1788530593.753339:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 224 off9312 00000040:00080000:1.0:1788530593.753349:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 224 off9536 00000040:00080000:1.0:1788530593.753359:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 128 off9664 00000040:00080000:1.0:1788530593.753372:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:1.0:1788530593.753383:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 224 off10112 00000040:00080000:1.0:1788530593.753394:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 128 off10240 00000100:00100000:1.0:1788530593.753417:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530593.753453:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.753487:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.753750:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955840 00000100:00100000:3.0:1788530593.753756:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955840 00000100:00100000:3.0:1788530593.753802:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530593.753809:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530593.753908:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955840:12345-0@lo:502:mount.lustre.0 Request processed in 89us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.753914:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788530593.755377:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530593.755462:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10464 00000040:00080000:1.0:1788530593.755476:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788530593.758905:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.758919:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.758921:0:23485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788530593.758929:0:23485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e03d6c000 00000020:00000080:3.0:1788530593.758932:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530593.758943:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.760063:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760069:0:23485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788530593.760078:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.760085:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760086:0:23485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788530593.760091:0:23485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e03d6c000 00000020:00000080:3.0:1788530593.760093:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530593.760164:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.760167:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760169:0:23485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788530593.760171:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.760173:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760175:0:23485:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530593.760179:0:23485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e03d6c000 00000020:00000080:3.0:1788530593.760181:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530593.760200:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.760203:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760204:0:23485:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530593.760206:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530593.760209:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760210:0:23485:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788530593.760227:0:23485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e03d6c000 00000020:00000080:3.0:1788530593.760229:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530593.760263:0:23485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530593.760266:0:23485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530593.760268:0:23485:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788530593.760271:0:23485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 13 count 13 00000020:01000000:0.0:1788530593.762326:0:23472:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788530593.762351:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530593.762380:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.762393:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530593.762461:0:23472:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788530593.762463:0:23472:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9e03d6c000 10000000:01000000:0.0:1788530593.762466:0:23472:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9e03d6c000 10000000:01000000:0.0:1788530593.762471:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530593.762488:0:23472:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788530593.762600:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530593.762607:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530593.762618:0:23472:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9e03d6c000 from 1 10000000:01000000:0.0:1788530593.762621:0:23472:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788530593.762653:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.762660:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.762671:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530593.762700:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530593.762765:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.762797:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715240 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.762880:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555955968 00000100:00100000:2.0:1788530593.762887:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555955968 00000100:00100000:2.0:1788530593.762927:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530593.762937:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:23472:x1875409555955968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530593.762960:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530593.762972:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141000/0xb28d70e1257521ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257521e5 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.763003:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141000/0xb28d70e1257521ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257521e5 expref: 19 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.763020:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141000/0xb28d70e1257521ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257521e5 expref: 19 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530593.763029:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141000, rc 0) 00000100:00100000:2.0:1788530593.763079:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555955968:12345-0@lo:101:mount.lustre.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.763085:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530593.763670:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555955968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530593.763687:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521ec expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.763696:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257521ec expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530593.772205:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000040:00080000:0.0:1788530593.772589:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530593.773694:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:0.0:1788530593.773737:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 120 off8536 00000040:00080000:0.0:1788530593.773749:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 168 off8704 00000040:00080000:0.0:1788530593.773760:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8928 00000040:00080000:0.0:1788530593.773771:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9152 00000040:00080000:0.0:1788530593.773782:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9272 00000040:00080000:0.0:1788530593.773792:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 168 off9440 00000040:00080000:0.0:1788530593.773802:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9664 00000040:00080000:0.0:1788530593.773814:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 224 off9888 00000040:00080000:0.0:1788530593.773825:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 120 off10008 00000040:00080000:0.0:1788530593.773836:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10232 00000040:00080000:0.0:1788530593.773846:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 224 off10456 00000040:00080000:0.0:1788530593.773857:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 88 off10544 00000040:00080000:0.0:1788530593.773867:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].14, 128 off10672 00000040:00080000:0.0:1788530593.773878:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].15, 144 off10816 00000040:00080000:0.0:1788530593.773889:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].16, 160 off10976 00000040:00080000:0.0:1788530593.773922:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].17, 224 off11200 00000040:00080000:0.0:1788530593.774176:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].18, 224 off11424 00000040:00080000:0.0:1788530593.774195:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].19, 80 off11504 00000040:00080000:0.0:1788530593.774206:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].20, 224 off11728 00000040:00080000:0.0:1788530593.774218:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].21, 224 off11952 00000040:00080000:0.0:1788530593.774228:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].22, 88 off12040 00000040:00080000:0.0:1788530593.774328:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].23, 128 off12168 00000040:00080000:0.0:1788530593.774348:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].24, 144 off12312 00000040:00080000:0.0:1788530593.774360:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].25, 160 off12472 00000040:00080000:0.0:1788530593.774371:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].26, 224 off12696 00000040:00080000:0.0:1788530593.774382:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].27, 224 off12920 00000040:00080000:0.0:1788530593.774392:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].28, 80 off13000 00000040:00080000:0.0:1788530593.774403:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].29, 224 off13224 00000040:00080000:0.0:1788530593.774414:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].30, 224 off13448 00000040:00080000:0.0:1788530593.774425:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].31, 88 off13536 00000040:00080000:0.0:1788530593.774436:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].32, 128 off13664 00000040:00080000:0.0:1788530593.774457:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].33, 144 off13808 00000040:00080000:0.0:1788530593.774469:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].34, 128 off13936 00000040:00080000:0.0:1788530593.774480:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].35, 224 off14160 00000040:00080000:0.0:1788530593.774491:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].36, 224 off14384 00000040:00080000:0.0:1788530593.774502:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].37, 80 off14464 00000040:00080000:0.0:1788530593.774512:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].38, 224 off14688 00000040:00080000:0.0:1788530593.774523:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].39, 224 off14912 00000040:00080000:0.0:1788530593.774534:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].40, 88 off15000 00000040:00080000:0.0:1788530593.774544:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].41, 128 off15128 00000040:00080000:0.0:1788530593.774555:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].42, 144 off15272 00000040:00080000:0.0:1788530593.774590:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].43, 128 off15400 00000040:00080000:0.0:1788530593.774602:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].44, 224 off15624 00000040:00080000:0.0:1788530593.774613:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].45, 224 off15848 00000040:00080000:0.0:1788530593.774623:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].46, 80 off15928 00000040:00080000:0.0:1788530593.774634:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].47, 224 off16152 00000040:00080000:0.0:1788530593.774646:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].48, 232 off16384 00000040:00080000:0.0:1788530593.775396:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].49, 224 off16608 00000040:00080000:0.0:1788530593.775423:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].50, 120 off16728 00000040:00080000:0.0:1788530593.775447:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].51, 224 off16952 00000040:00080000:0.0:1788530593.775452:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 51 count 51 00000100:00100000:0.0:1788530593.775578:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530593.775641:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.775679:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.776067:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956096 00000100:00100000:3.0:1788530593.776077:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956096 00000100:00100000:3.0:1788530593.776129:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530593.776139:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530593.776277:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956096:12345-0@lo:501:mount.lustre.0 Request processed in 139us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.776285:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788530593.777173:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530593.777227:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530593.777851:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.777893:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956224 00000100:00100000:0.0:1788530593.777913:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956224 00000100:00100000:0.0:1788530593.779427:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788530593.779444:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530593.779606:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956224:12345-0@lo:503:mount.lustre.0 Request processed in 168us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530593.779615:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788530593.779684:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530593.780802:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956224:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788530593.784318:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530593.784416:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530593.784492:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.784537:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.790165:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956352 00000100:00100000:2.0:1788530593.790185:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956352 00000100:00100000:2.0:1788530593.790263:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530593.790275:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.790454:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956352:12345-0@lo:502:mount.lustre.0 Request processed in 181us (5962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.790461:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530593.790659:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530593.790912:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:0.0:1788530593.790957:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 120 off8536 00000040:00080000:0.0:1788530593.790987:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 168 off8704 00000040:00080000:0.0:1788530593.791014:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8928 00000040:00080000:0.0:1788530593.791032:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9152 00000040:00080000:0.0:1788530593.791048:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9272 00000040:00080000:0.0:1788530593.791062:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 168 off9440 00000040:00080000:0.0:1788530593.791075:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9664 00000040:00080000:0.0:1788530593.791088:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 224 off9888 00000040:00080000:0.0:1788530593.791102:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 120 off10008 00000040:00080000:0.0:1788530593.799303:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10232 00000040:00080000:0.0:1788530593.799341:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 224 off10456 00000040:00080000:0.0:1788530593.799358:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 88 off10544 00000040:00080000:0.0:1788530593.799372:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].14, 128 off10672 00000040:00080000:0.0:1788530593.799396:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].15, 144 off10816 00000040:00080000:0.0:1788530593.799412:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].16, 160 off10976 00000040:00080000:0.0:1788530593.799425:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].17, 224 off11200 00000040:00080000:0.0:1788530593.799436:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].18, 224 off11424 00000040:00080000:0.0:1788530593.799447:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].19, 80 off11504 00000040:00080000:0.0:1788530593.799459:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].20, 224 off11728 00000040:00080000:0.0:1788530593.799470:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].21, 224 off11952 00000040:00080000:0.0:1788530593.799483:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].22, 88 off12040 00000040:00080000:0.0:1788530593.799497:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].23, 128 off12168 00000040:00080000:0.0:1788530593.799513:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].24, 144 off12312 00000040:00080000:0.0:1788530593.799529:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].25, 160 off12472 00000040:00080000:0.0:1788530593.799545:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].26, 224 off12696 00000040:00080000:0.0:1788530593.799891:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].27, 224 off12920 00000040:00080000:0.0:1788530593.800057:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].28, 80 off13000 00000040:00080000:0.0:1788530593.800075:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].29, 224 off13224 00000040:00080000:0.0:1788530593.800089:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].30, 224 off13448 00000040:00080000:0.0:1788530593.800102:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].31, 88 off13536 00000040:00080000:0.0:1788530593.800116:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].32, 128 off13664 00000040:00080000:0.0:1788530593.800132:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].33, 144 off13808 00000040:00080000:0.0:1788530593.800146:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].34, 128 off13936 00000040:00080000:0.0:1788530593.800161:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].35, 224 off14160 00000040:00080000:0.0:1788530593.800177:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].36, 224 off14384 00000040:00080000:0.0:1788530593.800205:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].37, 80 off14464 00000040:00080000:0.0:1788530593.800219:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].38, 224 off14688 00000040:00080000:0.0:1788530593.800232:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].39, 224 off14912 00000040:00080000:0.0:1788530593.800313:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].40, 88 off15000 00000040:00080000:0.0:1788530593.800329:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].41, 128 off15128 00000040:00080000:0.0:1788530593.800341:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].42, 144 off15272 00000040:00080000:0.0:1788530593.800369:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].43, 128 off15400 00000040:00080000:0.0:1788530593.800386:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].44, 224 off15624 00000040:00080000:0.0:1788530593.800401:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].45, 224 off15848 00000040:00080000:0.0:1788530593.800415:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].46, 80 off15928 00000040:00080000:0.0:1788530593.800430:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].47, 224 off16152 00000040:00080000:0.0:1788530593.800443:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].48, 232 off16384 00000100:00100000:0.0:1788530593.800505:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530593.801079:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.801179:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.805391:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956480 00000100:00100000:2.0:1788530593.805407:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956480 00000100:00100000:2.0:1788530593.805466:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530593.805476:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.805662:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956480:12345-0@lo:502:mount.lustre.0 Request processed in 187us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.805670:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788530593.808451:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530593.808685:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].49, 224 off16608 00000040:00080000:0.0:1788530593.808710:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].50, 120 off16728 00000100:00100000:0.0:1788530593.808747:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530593.808814:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530593.808851:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956608 00000100:00100000:0.0:1788530593.808853:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530593.808857:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956608 00000100:00100000:2.0:1788530593.808915:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530593.808925:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530593.809033:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956608:12345-0@lo:502:mount.lustre.0 Request processed in 109us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.809046:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788530593.812338:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530593.812437:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].51, 224 off16952 00000040:00080000:0.0:1788530593.812451:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788530593.814195:0:23490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788530593.814214:0:23490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a9f2c148000) 00000020:00000080:1.0:1788530593.814237:0:23490:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788530593.814342:0:23490:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e03d6c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788530593.814347:0:23490:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e03d6c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788530593.814349:0:23490:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e03d6c000 3 00010000:00080000:1.0:1788530593.814382:0:23490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3b05e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530593.817778:0:23490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788530593.818370:0:23490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788530593.818415:0:23490:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788530593.818428:0:23490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb28d70e1257521fa 00000100:00080000:1.0:1788530593.818440:0:23490:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530593.818446:0:23490:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a9f3b05e800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530593.818491:0:23490:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375f800 x1875409555956736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530593.818521:0:23490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788530593.818690:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555956736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788530593.818759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788530593.820357:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000100:00100000:2.0:1788530593.821654:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956736 00000100:00100000:2.0:1788530593.821668:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956736 00000100:00100000:2.0:1788530593.821724:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530593.821733:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555956736:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788530593.821764:0:22743:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:2.0:1788530593.821801:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb28d70e125752201 00000004:00100000:2.0:1788530593.821816:0:22743:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788530593.821849:0:22743:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530593.821943:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875409555956736:12345-0@lo:38:llog_process_th.0 Request processed in 210us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530593.821951:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788530593.821987:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9e0375f800 x1875409555956736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530593.822012:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530593.822020:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788530593.822028:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788530593.822033:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788530593.822036:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788530593.822806:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555956736:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788530593.824482:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530593.824490:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530593.824493:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530593.824496:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788530593.827188:0:23472:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788530593.827211:0:23472:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530593.827240:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521ec expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530593.827253:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2600/0xb28d70e1257521e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257521ec expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788530593.827315:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788530593.827317:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788530593.827318:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530593.827319:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530593.827321:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530593.827322:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530593.827324:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788530593.827325:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530593.827327:0:23472:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530593.827331:0:23472:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788530593.827333:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530593.827335:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788530593.827336:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530593.827337:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530593.827338:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530593.827339:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530593.827340:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788530593.827346:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530593.827348:0:23472:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530593.827377:0:23472:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788530593.827399:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788530593.827464:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.827502:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530593.827795:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956864 00000100:00100000:0.0:1788530593.827802:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956864 00000100:00100000:0.0:1788530593.827852:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788530593.827860:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788530593.827885:0:22736:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788530593.827898:0:22736:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788530593.829667:0:22721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788530593.829693:0:22736:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788530593.829706:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788530593.829943:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:23472:x1875409555956864:12345-0@lo:253:mount.lustre.0 Request processed in 2078us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530593.830509:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788530593.830593:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:23472:1875409555956864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530593.830606:0:23472:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788530593.830610:0:23472:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530593.830612:0:23472:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788530593.830613:0:23472:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530593.830614:0:23472:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530593.830616:0:23472:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530593.830617:0:23472:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530593.830619:0:23472:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788530593.830621:0:23472:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530593.830622:0:23472:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788530593.830637:0:23472:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788530593.831151:0:22757:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788530593.831157:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788530593.831178:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831193:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831201:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831208:0:22757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831243:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831258:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 18 pid: 22734 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.831271:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555956992:0@lo:104: 00000100:00100000:1.0:1788530593.831323:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530593.831366:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831374:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 18 pid: 22736 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.831383:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555957120:0@lo:104: 00000100:00100000:1.0:1788530593.831403:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.831422:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530593.831439:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555956992 00000100:00100000:1.0:1788530593.831444:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555956992 00000100:00100000:1.0:1788530593.831471:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957120 00000100:00100000:1.0:1788530593.831474:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957120 00000100:00100000:1.0:1788530593.831487:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530593.831495:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555956992:12345-0@lo:104: 00010000:00010000:1.0:1788530593.831508:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831552:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530593.831558:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555956992:12345-0@lo:104: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.831579:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530593.831593:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788530593.831599:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555957120:12345-0@lo:104: 00010000:00010000:1.0:1788530593.831606:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831635:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530593.831645:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555957120:12345-0@lo:104: Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.831651:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788530593.831668:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530593.831674:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831682:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530593.831686:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831695:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530593.831779:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530593.831785:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530593.831819:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831827:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530593.831846:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831853:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141400/0xb28d70e1257521c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521d0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831864:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530593.831868:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831882:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530593.831884:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.831891:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530593.832012:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530593.832019:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530593.832033:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832038:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530593.832045:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832051:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3a00/0xb28d70e1257520f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520fe expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832065:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530593.832067:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530593.832068:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530593.832075:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530593.832087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555957248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530593.832117:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.832140:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530593.832146:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555957376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530593.832173:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530593.832206:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957248 00000100:00100000:1.0:1788530593.832210:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957248 00010000:00010000:1.0:1788530593.832227:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 19 pid: 22734 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.832247:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957376 00000100:00100000:1.0:1788530593.832250:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957376 00010000:00010000:1.0:1788530593.832260:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 20 pid: 22736 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.832272:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530593.832279:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:3649:x1875409555957248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530593.832289:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530593.832293:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 20 pid: 22734 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832303:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 20 pid: 22734 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832317:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530593.832354:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:3649:x1875409555957248:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.832361:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530593.832374:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788530593.832380:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3649:x1875409555957376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530593.832387:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530593.832392:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 19 pid: 22736 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832410:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 19 pid: 22736 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832421:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832428:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530593.832439:0:22726:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017298453s 00010000:00010000:1.0:1788530593.832443:0:22726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832451:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832457:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832464:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832469:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530593.832474:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832480:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832488:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832502:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530593.832525:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3649:x1875409555957376:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530593.832530:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788530593.832582:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00030c00/0xb28d70e1257521d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257521c9 expref: 18 pid: 22734 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.832593:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555956992:0@lo:104: 00010000:00010000:1.0:1788530593.832604:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e010a3800/0xb28d70e1257520fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257520f7 expref: 17 pid: 22736 timeout: 901 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530593.832611:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555957120:0@lo:104: 00010000:00010000:1.0:1788530593.832628:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832636:0:22757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832642:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530593.832647:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166800/0xb28d70e125752208 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530593.832790:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555957376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530593.832807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555957248:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788530593.838766:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788530593.839000:0:23496:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788530593.839005:0:23496:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788530593.839150:0:23497:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788530593.839302:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788530593.839540:0:23497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530593.840344:0:23498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788530593.840408:0:23498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530593.840437:0:23498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.840527:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957504 00000100:00100000:3.0:1788530593.840534:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957504 00000100:00100000:3.0:1788530593.840611:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530593.840622:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957504:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.840694:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.840701:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530593.840750:0:23498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957504:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788530593.840779:0:23498:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788530593.840813:0:23498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.840843:0:23498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.840862:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957632 00000100:00100000:3.0:1788530593.840866:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957632 00000100:00100000:3.0:1788530593.840885:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530593.840891:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.840971:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.841115:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530593.841179:0:23498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.841194:0:23498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957632:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788530593.841202:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788530593.841240:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530593.841251:0:23498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23498:1875409555957760:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.841277:0:23498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.841307:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957760 00000100:00100000:3.0:1788530593.841310:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957760 00000100:00100000:3.0:1788530593.841330:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530593.841336:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23498:x1875409555957760:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.841363:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23498:x1875409555957760:12345-0@lo:900:lod0001_rec0000.0 Request processed in 27us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.841369:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530593.841384:0:23498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbf840 going to sleep for 11 seconds 00010000:00080000:3.0:1788530593.841396:0:23498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3df90380 x1875409555957760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530609 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530593.841407:0:23498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23498:1875409555957760:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.841437:0:23498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957888:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.841464:0:23498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530593.841479:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555957888 00000100:00100000:3.0:1788530593.841482:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555957888 00000100:00100000:3.0:1788530593.841497:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530593.841502:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957888:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788530593.841548:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23498:x1875409555957888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 46us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530593.841554:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530593.841784:0:23498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530593.841798:0:23498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23498:1875409555957888:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788530593.841829:0:23498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788530593.842930:0:23472:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788530593.842958:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788530593.843032:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530593.845212:0:23498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788530593.845344:0:23498:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788530593.847260:0:23497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788530593.847332:0:23497:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788530593.847337:0:23497:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:1.0:1788530593.847521:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788530593.849142:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788530593.849203:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788530593.849452:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788530593.851184:0:23472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1788530593.853005:0:23472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788530593.864852:0:23472:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788530593.864892:0:23472:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb37801c679b8 00100000:10000000:1.0:1788530593.864912:0:23472:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788530593.866364:0:23472:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788530593.866396:0:23472:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788530593.867146:0:23472:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530593.867351:0:23472:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788530594.115545:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530594.757285:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530594.881808:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788530595.138610:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 10000000:01000000:0.0:1788530595.456615:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530595.456622:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03d6c000 from 12 10000000:01000000:0.0:1788530595.456627:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530595.456672:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530595.456693:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530595.456704:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530595.456728:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530595.456793:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530595.456832:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530595.456883:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958016 00000100:00100000:2.0:1788530595.456890:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958016 00000100:00100000:2.0:1788530595.456947:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788530595.456957:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:22738:x1875409555958016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530595.456984:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530595.456998:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575220f expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.457037:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575220f expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.457049:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575220f expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.457058:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141600, rc 0) 00000100:00100000:2.0:1788530595.457099:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555958016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530595.457105:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788530595.457492:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530595.457508:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.457518:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530595.457783:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788530595.457816:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530595.457868:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530595.457944:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958144 00000100:00100000:0.0:1788530595.457949:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958144 00000100:00100000:0.0:1788530595.458029:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788530595.458036:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555958144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530595.458052:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530595.458073:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530595.458076:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788530595.458154:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555958144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530595.458162:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530595.458216:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788530595.458271:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530595.458278:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.458286:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530595.458298:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788530595.458300:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f3b266000 from 12 10000000:01000000:1.0:1788530595.458302:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530595.458319:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.458331:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.458340:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530595.458353:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530595.458377:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530595.458497:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530595.458524:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958272 00000100:00100000:2.0:1788530595.458528:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958272 00000100:00100000:2.0:1788530595.458547:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788530595.458553:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555958272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530595.458589:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530595.458599:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575221d expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.458615:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575221d expref: 19 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.458623:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575221d expref: 19 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530595.458630:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140000, rc 0) 00000100:00100000:2.0:1788530595.458664:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555958272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530595.458680:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788530595.458780:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530595.458790:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.458798:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530595.458835:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788530595.458863:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530595.458883:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530595.459085:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958400 00000100:00100000:2.0:1788530595.459090:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958400 00000100:00100000:2.0:1788530595.459109:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788530595.459116:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555958400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530595.459126:0:22734:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530595.459137:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530595.459140:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788530595.459221:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555958400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530595.459314:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555958400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788530595.459349:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530595.459355:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530595.459363:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530595.459408:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1788530595.779859:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530595.905424:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530596.160857:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:0.0:1788530596.800653:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530597.184633:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:1.0:1788530597.834405:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530598.209332:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 0 seconds 00010000:00010000:1.0:1788530598.849418:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530598.987631:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555958528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530598.987753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530598.988675:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958528 00000100:00100000:3.0:1788530598.988686:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958528 00000100:00100000:3.0:1788530598.988738:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530598.988747:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555958528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530598.988893:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530598.988972:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555958528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530598.988991:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530598.989914:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555958528:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788530598.990040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788530598.990045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788530598.990069:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530598.990074:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 801 00000100:00080000:2.0:1788530598.990078:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788530598.990083:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e01aa3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530598.990108:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f32bd1500 x1875409555958784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530598.990126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530598.990131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530598.990133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530598.990136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530598.990155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530598.990165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530598.990168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530598.990171:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788530598.990200:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555958784:0@lo:38:kworker.0 00000100:00100000:2.0:1788530598.990243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530598.990280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555958912:0@lo:400:kworker.0 00000100:00100000:2.0:1788530598.990358:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530598.990378:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530598.990383:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555959040:0@lo:400:kworker.0 00000100:00100000:2.0:1788530598.990405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530598.990434:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958784 00000100:00100000:2.0:1788530598.990439:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958784 00000100:00100000:2.0:1788530598.990466:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530598.990472:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555958784:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788530598.990495:0:22746:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:2.0:1788530598.990533:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e12575222b 00000004:00100000:2.0:1788530598.990548:0:22746:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788530598.990553:0:22746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788530598.990647:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958912 00000100:00100000:2.0:1788530598.990651:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958912 00000100:00100000:2.0:1788530598.990678:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959040 00000100:00100000:2.0:1788530598.990681:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959040 00000100:00100000:2.0:1788530598.990693:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530598.990699:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555958912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530598.990741:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555958912:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530598.990755:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530598.990771:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530598.990775:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555959040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530598.990891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530598.990902:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555958656:0@lo:400:kworker.0 00000100:00100000:1.0:1788530598.990945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530598.992007:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555959040:12345-0@lo:400:kworker.0 Request processed in 1226us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530598.992016:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530598.992056:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555958656 00000100:00100000:2.0:1788530598.992061:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555958656 00000100:00100000:2.0:1788530598.992139:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788530598.992148:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3647:x1875409555958656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530598.992204:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3647:x1875409555958656:12345-0@lo:400:kworker.0 Request processed in 57us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530598.992211:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788530599.005990:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd3800 x1875409555959040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530599.006010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555959040:0@lo:400:kworker.0 00010000:00080000:2.0:1788530599.006023:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd2300 x1875409555958912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530599.006032:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555958912:0@lo:400:kworker.0 00000100:00100000:2.0:1788530599.006075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555958656:0@lo:400:kworker.0 00000100:00080000:3.0:1788530599.008398:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530599.008483:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555958784:12345-0@lo:38:kworker.0 Request processed in 18008us (18237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530599.008494:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530599.008661:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530599.008671:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788530599.008678:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788530599.008693:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788530599.008696:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788530599.008754:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009d932df4): req@ffff9a9f32bd2680 x1875409555951360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530599.008773:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555958784:0@lo:38:kworker.0 00000100:00100000:3.0:1788530599.011103:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530599.011139:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530599.014903:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555951360 00000100:00100000:2.0:1788530599.014916:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555951360 00000100:00100000:2.0:1788530599.014991:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530599.015002:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555951360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015136:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555951360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 135us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530599.015144:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530599.015206:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1875409555951360:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788530599.015247:0:22782:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788530599.015289:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1875409555959168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015330:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530599.015362:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f176a4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788530599.015374:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959168 00000100:00100000:2.0:1788530599.015377:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959168 00000100:00100000:2.0:1788530599.015395:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788530599.015402:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555959168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015500:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555959168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530599.015507:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788530599.015531:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1875409555959168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015647:0:22782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1875409555959296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015672:0:22782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530599.015687:0:22782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f176a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530599.015698:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959296 00000100:00100000:2.0:1788530599.015701:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959296 00000100:00100000:2.0:1788530599.015718:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788530599.015724:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555959296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788530599.015767:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1875409555959296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530599.015774:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788530599.015941:0:22782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1875409555959296:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788530599.015982:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530599.019379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530599.019401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555959424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530599.019465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530599.020632:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959424 00000100:00100000:3.0:1788530599.020642:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959424 00000100:00100000:3.0:1788530599.020704:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530599.020714:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555959424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530599.020748:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530599.020886:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555959424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530599.020894:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530599.020954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555959424:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788530599.027980:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788530599.028068:0:22782:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1788530599.028074:0:22782:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1788530599.191945:0:23741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788530599.877960:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530600.193754:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788530600.515282:0:23794:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530600.515487:0:23794:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530600.897924:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530601.535633:0:23844:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530601.538479:0:23844:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530601.922773:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530602.801044:0:23892:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff6645080 20000000:00000080:0.0:1788530602.801061:0:23892:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9f0649f000 uarg=0000000000000000 20000000:01000000:0.0:1788530602.801102:0:23892:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788530602.801110:0:23892:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788530602.801115:0:23892:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788530602.804002:0:23893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788530602.804313:0:23892:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788530602.818002:0:23892:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788530602.818322:0:23892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818342:0:23892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818349:0:23892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818357:0:23892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818421:0:23892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818435:0:23892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 18 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530602.818450:0:23892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23892:1875409555959552:0@lo:104: 00000100:00100000:3.0:1788530602.818512:0:23892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530602.818584:0:23892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.818593:0:23892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 18 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530602.818601:0:23892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23892:1875409555959680:0@lo:104: 00000100:00100000:3.0:1788530602.818621:0:23892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530602.818638:0:23892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d98300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530602.818807:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959552 00000100:00100000:1.0:1788530602.818815:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959552 00000100:00100000:1.0:1788530602.818851:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959680 00000100:00100000:1.0:1788530602.818854:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959680 00000100:00100000:1.0:1788530602.818867:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530602.818876:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:23892:x1875409555959552:12345-0@lo:104: 00010000:00010000:1.0:1788530602.818888:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.818967:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530602.818973:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:23892:x1875409555959552:12345-0@lo:104: Request processed in 98us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530602.818980:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530602.818996:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530602.819002:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:23892:x1875409555959680:12345-0@lo:104: 00010000:00010000:1.0:1788530602.819010:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819043:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530602.819049:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:23892:x1875409555959680:12345-0@lo:104: Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530602.819055:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788530602.819072:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530602.819077:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819084:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530602.819088:0:22729:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819097:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530602.819104:0:22729:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530602.819110:0:22729:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530602.819143:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819150:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530602.819239:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819247:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3c00/0xb28d70e1257521d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257521de expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819263:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530602.819266:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819272:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530602.819275:0:22729:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819292:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530602.819299:0:22729:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530602.819304:0:22729:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530602.819318:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819324:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530602.819339:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819355:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e1257520c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257520cd expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819369:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530602.819370:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530602.819372:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530602.819391:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555959808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530602.819419:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530602.819458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555959936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530602.819481:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530602.819522:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959808 00000100:00100000:1.0:1788530602.819526:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959808 00010000:00010000:1.0:1788530602.819543:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 19 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530602.819596:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555959936 00000100:00100000:1.0:1788530602.819600:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555959936 00010000:00010000:1.0:1788530602.819612:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 20 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530602.819624:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530602.819630:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:3648:x1875409555959808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530602.819639:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530602.819644:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 20 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.819654:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 20 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530602.819785:0:23892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23892:1875409555959552:0@lo:104: 00000100:00100000:3.0:1788530602.819794:0:23892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23892:1875409555959680:0@lo:104: 00010000:00010000:0.0:1788530602.819955:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530602.820064:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788530602.820072:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788530602.820097:0:22728:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788530602.820106:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530602.820114:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:3649:x1875409555959936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530602.820123:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530602.820128:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 20 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530602.820592:0:23892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.823789:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257521de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257521d7 expref: 20 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.823813:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530602.823973:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3648:x1875409555959808:12345-0@lo:103:ldlm_bl.0 Request processed in 4341us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530602.823984:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788530602.824583:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 18 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.824600:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e010a2c00/0xb28d70e1257520cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257520c6 expref: 18 pid: 22736 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.824615:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.824624:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826768:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826788:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826795:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826803:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826809:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530602.826814:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826822:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826869:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530602.826882:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530602.826975:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:3649:x1875409555959936:12345-0@lo:103:ldlm_bl.0 Request processed in 6859us (7489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530602.826987:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530602.827097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555959936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530602.827133:0:23892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.827141:0:23892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530602.827148:0:23892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00031a00/0xb28d70e125752232 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530602.831783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555959808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530602.944827:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530603.073306:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530593/real 1788530593] req@ffff9a9f32bd0a80 x1875409555954944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073341:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f32bd0a80 x1875409555954944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073351:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530593/real 1788530593] req@ffff9a9e0375f100 x1875409555954688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073361:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375f100 x1875409555954688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073383:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530588/real 1788530588] req@ffff9a9f3df91500 x1875409555952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073396:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f3df91500 x1875409555952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073405:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530588/real 1788530588] req@ffff9a9f3df93800 x1875409555952512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.073415:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f3df93800 x1875409555952512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788530603.073435:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530603.073453:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788530603.073457:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954944:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788530603.073463:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaed000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530603.073468:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788530603.073470:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555954688:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788530603.073474:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530603.073478:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788530603.073480:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952384:0@lo:8:kworker.0 00000100:00080000:1.0:1788530603.073484:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530603.073487:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788530603.073490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555952512:0@lo:8:kworker.0 00000100:00080000:1.0:1788530603.073729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530603.073741:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530603.073743:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530603.073748:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 796 00000100:00080000:1.0:1788530603.073753:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530603.073760:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e01aa1000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530603.073782:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375ce00 x1875409555960192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530603.073794:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530603.073797:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530603.073798:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530603.073801:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 796 00000100:00080000:1.0:1788530603.073804:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530603.073806:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530603.073818:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375e300 x1875409555960320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530603.073852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530603.073854:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530603.073856:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaed000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530603.073858:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 801 00000100:00080000:1.0:1788530603.073861:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788530603.073864:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f0aaed000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530603.073874:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375ed80 x1875409555960704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530603.073882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530603.073902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530603.073904:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530603.073907:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 801 00000100:00080000:1.0:1788530603.073909:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788530603.073912:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530603.073924:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0375dc00 x1875409555960832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530603.073960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555960064:0@lo:400:kworker.0 00000100:00100000:1.0:1788530603.074029:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530603.074066:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530603.074072:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555960960:0@lo:400:kworker.0 00000100:00100000:1.0:1788530603.074102:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530603.074132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555960192:0@lo:8:kworker.0 00000100:00100000:0.0:1788530603.075863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555960576:0@lo:400:kworker.0 00000100:00100000:0.0:1788530603.075944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530603.075988:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530603.075996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555960448:0@lo:400:kworker.0 00000100:00100000:0.0:1788530603.076021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530603.076057:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555960960 00000100:00100000:0.0:1788530603.076066:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555960960 00000100:00100000:0.0:1788530603.076111:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555960448 00000100:00100000:0.0:1788530603.076114:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555960448 00000100:00100000:0.0:1788530603.076128:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530603.076136:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555960960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530603.076186:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555960960:12345-0@lo:400:kworker.0 Request processed in 51us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530603.076204:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530603.076222:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530603.076227:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555960448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530603.076257:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555960448:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530603.076262:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788530603.076298:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9e0375c380 x1875409555960448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530603.076312:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555960448:0@lo:400:kworker.0 00000100:00100000:3.0:1788530603.076383:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555960064 00000100:00100000:3.0:1788530603.076387:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555960064 00000100:00100000:3.0:1788530603.076410:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555960576 00000100:00100000:3.0:1788530603.076413:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555960576 00000100:00100000:3.0:1788530603.076437:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530603.076444:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555960064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530603.076483:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555960064:12345-0@lo:400:kworker.0 Request processed in 40us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530603.076489:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530603.076503:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530603.076508:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555960576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530603.076546:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555960576:12345-0@lo:400:kworker.0 Request processed in 38us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530603.076552:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000400:00000100:1.0:1788530603.076597:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555960192 offset 0 length 520: 4 00000100:00100000:1.0:1788530603.076700:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555960320:0@lo:8:kworker.0 00000400:00000100:1.0:1788530603.076726:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555960320 offset 0 length 520: 4 00000100:00100000:1.0:1788530603.076740:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555960704:0@lo:8:kworker.0 00000400:00000100:1.0:1788530603.076756:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555960704 offset 0 length 520: 4 00000100:00100000:1.0:1788530603.076767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555960832:0@lo:8:kworker.0 00000400:00000100:1.0:1788530603.076799:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555960832 offset 0 length 520: 4 00010000:00080000:1.0:1788530603.076844:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9e0375fb80 x1875409555960960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530603.076854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555960960:0@lo:400:kworker.0 00000100:00100000:1.0:1788530603.076876:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555960064:0@lo:400:kworker.0 00000100:00100000:0.0:1788530603.079724:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555960576:0@lo:400:kworker.0 00010000:00010000:0.0:1788530603.968848:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530604.097472:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530604.097496:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555961088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530604.097585:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530604.098529:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961088 00000100:00100000:1.0:1788530604.098538:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961088 00000100:00100000:1.0:1788530604.098626:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530604.098636:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555961088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530604.098827:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788530604.098906:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555961088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 271us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530604.098914:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530604.098963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555961088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530604.100316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555961216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530604.100368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530604.100416:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961216 00000100:00100000:2.0:1788530604.100422:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961216 00000100:00100000:2.0:1788530604.100453:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530604.100460:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555961216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530604.100485:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530604.100525:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555961216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.100531:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530604.100590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555961216:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788530604.678396:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788530604.678404:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03d6c000 from 13 10000000:01000000:3.0:1788530604.678410:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530604.678453:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530604.678465:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530604.678475:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530604.678500:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530604.678584:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530604.678637:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d98000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530604.679792:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961344 00000100:00100000:2.0:1788530604.679803:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961344 00000100:00100000:2.0:1788530604.679861:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788530604.679882:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+17:22738:x1875409555961344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530604.679897:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530604.679915:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752239 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.679957:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752239 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.679968:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752239 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.679976:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141800, rc 0) 00000100:00100000:2.0:1788530604.680045:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.680052:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788530604.680401:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530604.680419:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530604.680428:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530604.680908:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 13 count 13 00000040:00080000:0.0:1788530604.681990:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530604.682301:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:0.0:1788530604.690024:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:0.0:1788530604.690082:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:0.0:1788530604.690098:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8976 00000040:00080000:0.0:1788530604.690113:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 112 off9088 00000040:00080000:0.0:1788530604.690125:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 224 off9312 00000040:00080000:0.0:1788530604.690149:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].7, 224 off9536 00000040:00080000:0.0:1788530604.690167:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].8, 128 off9664 00000040:00080000:0.0:1788530604.690181:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].9, 224 off9888 00000040:00080000:0.0:1788530604.690193:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].10, 224 off10112 00000040:00080000:0.0:1788530604.690206:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].11, 128 off10240 00000040:00080000:0.0:1788530604.690232:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].12, 224 off10464 00000040:00080000:0.0:1788530604.690238:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 12 count 13 00000100:00100000:0.0:1788530604.690349:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530604.690412:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530604.690458:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530604.690660:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961472 00000100:00100000:2.0:1788530604.690667:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961472 00000100:00100000:2.0:1788530604.690710:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788530604.690720:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530604.690831:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.690840:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000001:00100000:3.0:1788530604.691718:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788530604.691863:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530604.691918:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530604.691975:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530604.692011:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530604.692065:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961600 00000100:00100000:3.0:1788530604.692070:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961600 00000100:00100000:3.0:1788530604.692144:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530604.692161:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530604.692255:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530604.692263:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788530604.692336:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530604.692757:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530604.692818:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961728:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530604.692855:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530604.697859:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530604.698159:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961728 00000100:00100000:2.0:1788530604.698168:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961728 00000100:00100000:2.0:1788530604.698212:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530604.698221:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961728:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530604.698373:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961728:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 152us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.698381:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788530604.698531:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961728:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530604.698793:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:0.0:1788530604.698828:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:0.0:1788530604.698841:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:0.0:1788530604.698868:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:0.0:1788530604.698899:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000040:00080000:0.0:1788530604.698914:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:0.0:1788530604.698926:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 224 off9536 00000040:00080000:0.0:1788530604.698940:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 128 off9664 00000040:00080000:0.0:1788530604.698953:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9888 00000040:00080000:0.0:1788530604.698965:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10112 00000040:00080000:0.0:1788530604.698981:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 128 off10240 00000100:00100000:0.0:1788530604.699015:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961856:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530604.699062:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530604.699084:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530604.699234:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961856 00000100:00100000:2.0:1788530604.699239:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961856 00000100:00100000:2.0:1788530604.699266:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530604.699271:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961856:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530604.699343:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961856:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.699350:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788530604.699422:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961856:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530604.699455:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 224 off10464 00000040:00080000:0.0:1788530604.699462:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:3.0:1788530604.701294:0:23969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 64768 count 13 00000020:01000000:2.0:1788530604.706297:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530604.706322:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530604.706334:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.706346:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530604.706692:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530604.706696:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f3b266000 from 13 10000000:01000000:1.0:1788530604.706699:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530604.706741:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530604.706749:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530604.706760:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530604.706784:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530604.706843:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530604.706888:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530604.706946:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555961984 00000100:00100000:2.0:1788530604.706953:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555961984 00000100:00100000:2.0:1788530604.707040:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530604.707051:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+18:22738:x1875409555961984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530604.707064:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530604.707076:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752247 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.707100:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752247 expref: 19 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.707110:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752247 expref: 19 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.707119:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140a00, rc 0) 00000100:00100000:2.0:1788530604.707173:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555961984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530604.707192:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788530604.707259:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555961984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530604.707276:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530604.707292:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530604.707328:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530604.707354:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530604.709557:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530604.709969:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962112 00000100:00100000:3.0:1788530604.709978:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962112 00000100:00100000:3.0:1788530604.710025:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530604.710034:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555962112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530604.710261:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555962112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530604.710270:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788530604.710505:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530604.710555:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555962240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530604.710652:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530604.710675:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962240 00000100:00100000:1.0:1788530604.710679:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962240 00000100:00100000:1.0:1788530604.710699:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788530604.710705:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555962240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530604.710778:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:22738:x1875409555962240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530604.710785:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788530604.710822:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530604.710835:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555962240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530604.712239:0:23971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788530604.712449:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530604.712460:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530604.712472:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530604.712482:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530605.001512:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530605.125044:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530606.016638:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530607.041660:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530608.065491:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530608.193213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530608.193219:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530608.193222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530608.193225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530608.193241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530608.193245:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530608.193247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530608.193250:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788530608.193279:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555962368:0@lo:400:kworker.0 00000100:00100000:2.0:1788530608.193351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530608.193396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555962880:0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.193398:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962368 00000100:00100000:1.0:1788530608.193405:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962368 00000100:00100000:2.0:1788530608.193421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530608.193439:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530608.193444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555962752:0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.193451:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788530608.193460:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3648:x1875409555962368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530608.193480:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530608.193509:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555962496:0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.193514:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:3648:x1875409555962368:12345-0@lo:400:kworker.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530608.193521:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788530608.193528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530608.194853:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962880 00000100:00100000:0.0:1788530608.194861:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962880 00000100:00100000:0.0:1788530608.194902:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530608.194911:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555962880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530608.194964:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555962880:12345-0@lo:400:kworker.0 Request processed in 55us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530608.194971:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530608.195360:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530608.195370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555962624:0@lo:400:kworker.0 00000100:00100000:2.0:1788530608.195401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530608.195454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555962368:0@lo:400:kworker.0 00010000:00080000:2.0:1788530608.195470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd0a80 x1875409555962880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530608.195480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555962880:0@lo:400:kworker.0 00000100:00100000:0.0:1788530608.195636:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962624 00000100:00100000:0.0:1788530608.195641:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962624 00000100:00100000:0.0:1788530608.195676:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788530608.195683:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555962624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530608.195722:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555962624:12345-0@lo:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530608.195741:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788530608.195771:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd1880 x1875409555962624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530608.195781:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555962624:0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.197111:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962752 00000100:00100000:1.0:1788530608.197743:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962752 00000100:00100000:1.0:1788530608.197791:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555962496 00000100:00100000:1.0:1788530608.197795:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555962496 00000100:00100000:1.0:1788530608.197813:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530608.197822:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555962752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.197925:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555962752:12345-0@lo:400:kworker.0 Request processed in 103us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530608.197932:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530608.197947:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530608.197953:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555962496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530608.198368:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555962496:12345-0@lo:400:kworker.0 Request processed in 414us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530608.198376:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530608.198427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555962752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530608.200012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555962496:0@lo:400:kworker.0 00010000:00010000:1.0:1788530609.091725:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530609.216811:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530609.222238:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530609.222263:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555963136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530609.222333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.222377:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963136 00000100:00100000:2.0:1788530609.222384:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963136 00000100:00100000:2.0:1788530609.222426:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530609.222434:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555963136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530609.222477:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788530609.222518:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555963136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530609.222524:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530609.222585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555963136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530609.223535:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555963008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530609.223802:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.223894:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963008 00000100:00100000:2.0:1788530609.223900:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963008 00000100:00100000:2.0:1788530609.223944:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530609.223961:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555963008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530609.223985:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530609.224036:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555963008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530609.224043:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530609.224216:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555963008:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1788530609.629750:0:24241:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788530609.629754:0:24241:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788530609.629756:0:24241:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788530609.629872:0:24241:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f0aaea000 00000020:01000004:2.0:1788530609.629889:0:24241:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788530609.629902:0:24241:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788530609.629916:0:24241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a9f32881988) 00000020:00000080:2.0:1788530609.629932:0:24241:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788530609.669792:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788530609.671754:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788530609.672068:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788530609.672267:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788530609.672424:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788530609.672677:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788530609.672847:0:24241:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1788530609.674728:0:24241:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788530609.674957:0:24241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788530609.674972:0:24241:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788530609.674986:0:24241:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e12575225c 00000020:01000004:0.0:1788530609.674993:0:24241:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788530609.675020:0:24241:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788530609.675024:0:24241:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788530609.675030:0:24241:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788530609.675035:0:24241:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788530609.675046:0:24241:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a9e03778000) 00000020:00000080:0.0:1788530609.675058:0:24241:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788530609.677760:0:24241:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530609.677948:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788530609.677962:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788530609.678895:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788530609.678902:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788530609.679351:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788530609.679357:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788530609.680877:0:24241:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530609.681072:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788530609.681079:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788530609.689847:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788530609.689864:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788530609.723534:0:24241:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530609.723815:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788530609.723822:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788530609.734588:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788530609.734603:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788530609.738338:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530609.738350:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788530609.744540:0:24241:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530609.744884:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788530609.744891:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788530609.745888:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788530609.745896:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788530609.822792:0:24241:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530609.823031:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788530609.823038:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788530609.826406:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788530609.826434:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788530609.828363:0:24241:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788530609.828412:0:24241:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788530609.828418:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788530609.828419:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530609.828421:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530609.828422:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530609.828424:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530609.828425:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530609.828427:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530609.828429:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530609.828431:0:24241:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530609.828434:0:24241:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788530609.828436:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530609.828438:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530609.828439:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530609.828440:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530609.828441:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530609.828442:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530609.828443:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530609.828445:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530609.828446:0:24241:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530609.828473:0:24241:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788530609.828492:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788530609.830436:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530609.830506:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.830615:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963264 00000100:00100000:1.0:1788530609.830626:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963264 00000100:00100000:1.0:1788530609.830691:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788530609.830702:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:24241:x1875409555963264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788530609.830745:0:22736:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788530609.830748:0:22736:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788530609.830751:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788530609.831308:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:24241:x1875409555963264:12345-0@lo:253:mount.lustre.0 Request processed in 607us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.831316:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530609.831959:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530609.831978:0:24241:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788530609.831982:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530609.831984:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530609.831985:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530609.831986:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530609.831987:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530609.831989:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530609.831991:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530609.831993:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530609.831994:0:24241:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788530609.832019:0:24241:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f0aaea000 from lustre-OST0000 10000000:01000000:0.0:1788530609.832048:0:24241:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788530609.832051:0:24241:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788530609.832059:0:24241:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f0aaea000 10000000:01000000:0.0:1788530609.832064:0:24241:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530609.832220:0:24241:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788530609.844846:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530609.857851:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530609.857872:0:24241:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaea000 from 1 10000000:01000000:2.0:1788530609.857876:0:24241:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788530609.858142:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.858153:0:24241:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.858166:0:24241:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.858196:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530609.858268:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.858367:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.858701:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963392 00000100:00100000:1.0:1788530609.858709:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963392 00000100:00100000:1.0:1788530609.858791:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530609.858800:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+19:24241:x1875409555963392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530609.858812:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530609.858834:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167800/0xb28d70e125752271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575226a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.858856:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167800/0xb28d70e125752271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575226a expref: 20 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.858867:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167800/0xb28d70e125752271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575226a expref: 20 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.858876:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167800, rc 0) 00000100:00100000:1.0:1788530609.859008:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963392:12345-0@lo:101:mount.lustre.0 Request processed in 209us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.859016:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788530609.859527:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530609.859543:0:24241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752271 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.859579:0:24241:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752271 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.859663:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.859698:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.860655:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.861471:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963520 00000100:00100000:1.0:1788530609.861479:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963520 00000100:00100000:1.0:1788530609.861535:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530609.861543:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530609.861690:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963520:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1992us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530609.861698:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788530609.861896:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963520:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788530609.861919:0:24241:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788530609.862155:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.862190:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.862212:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.862273:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963648 00000100:00100000:3.0:1788530609.862278:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963648 00000100:00100000:3.0:1788530609.862301:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530609.862308:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530609.862364:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963648:12345-0@lo:501:mount.lustre.0 Request processed in 56us (174us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530609.862381:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788530609.862456:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963648:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788530609.862476:0:24241:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788530609.862496:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752271 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.862507:0:24241:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141e00/0xb28d70e12575226a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752271 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530609.862518:0:24241:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f0aaea000 10000000:01000000:2.0:1788530609.862524:0:24241:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788530609.862555:0:24241:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788530609.862659:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530609.862666:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530609.862675:0:24241:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788530609.862679:0:24241:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530609.862706:0:24241:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788530609.862734:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530609.862738:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530609.862744:0:24241:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f0aaea000 10000000:01000000:2.0:1788530609.862748:0:24241:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788530609.862766:0:24241:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788530609.862769:0:24241:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788530609.862792:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.862801:0:24241:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.862811:0:24241:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.862833:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530609.862862:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.863354:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.863422:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963776 00000100:00100000:1.0:1788530609.863427:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963776 00000100:00100000:1.0:1788530609.863450:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788530609.863457:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+20:24241:x1875409555963776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530609.863466:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530609.863479:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166800/0xb28d70e12575227f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752278 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.863501:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166800/0xb28d70e12575227f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752278 expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.863636:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166800/0xb28d70e12575227f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752278 expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.863645:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166800, rc 0) 00000100:00100000:1.0:1788530609.863687:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555963776:12345-0@lo:101:mount.lustre.0 Request processed in 230us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.863693:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788530609.863842:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530609.863857:0:24241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575227f expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.863866:0:24241:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575227f expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530609.864950:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000040:00080000:2.0:1788530609.866735:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530609.868778:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:2.0:1788530609.868816:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 128 off8544 00000040:00080000:2.0:1788530609.868843:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 112 off8656 00000040:00080000:2.0:1788530609.868858:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8880 00000040:00080000:2.0:1788530609.868872:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9104 00000040:00080000:2.0:1788530609.868884:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 80 off9184 00000040:00080000:2.0:1788530609.868921:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 224 off9408 00000040:00080000:2.0:1788530609.868937:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9632 00000040:00080000:2.0:1788530609.869115:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 80 off9712 00000040:00080000:2.0:1788530609.869135:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off9936 00000040:00080000:2.0:1788530609.869149:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10160 00000040:00080000:2.0:1788530609.869162:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 120 off10280 00000040:00080000:2.0:1788530609.869185:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 224 off10504 00000040:00080000:2.0:1788530609.869191:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 13 count 14 00000100:00100000:2.0:1788530609.869288:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.869356:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.869404:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.870320:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555963904 00000100:00100000:1.0:1788530609.870330:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555963904 00000100:00100000:1.0:1788530609.870388:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788530609.870398:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555963904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530609.870584:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555963904:12345-0@lo:501:mount.lustre.0 Request processed in 164us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.870605:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788530609.872410:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555963904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.872470:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530609.872542:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.872621:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.873216:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964032 00000100:00100000:0.0:1788530609.873225:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964032 00000100:00100000:0.0:1788530609.873285:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530609.873294:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530609.874216:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964032:12345-0@lo:503:mount.lustre.0 Request processed in 920us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.874226:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788530609.874346:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530609.874806:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530609.874887:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530609.874936:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.875142:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.879810:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964160 00000100:00100000:3.0:1788530609.879835:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964160 00000100:00100000:3.0:1788530609.879960:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788530609.879981:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530609.882791:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964160:12345-0@lo:502:mount.lustre.0 Request processed in 2807us (7848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.882805:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788530609.882930:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530609.883208:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:0.0:1788530609.883238:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 128 off8544 00000040:00080000:0.0:1788530609.883252:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 112 off8656 00000040:00080000:0.0:1788530609.883267:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8880 00000040:00080000:0.0:1788530609.883294:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9104 00000040:00080000:0.0:1788530609.883307:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 80 off9184 00000040:00080000:0.0:1788530609.883319:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 224 off9408 00000040:00080000:0.0:1788530609.883331:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9632 00000040:00080000:0.0:1788530609.883343:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 80 off9712 00000040:00080000:0.0:1788530609.883357:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off9936 00000040:00080000:0.0:1788530609.883369:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10160 00000040:00080000:0.0:1788530609.883398:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 120 off10280 00000100:00100000:0.0:1788530609.883432:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530609.883473:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530609.893861:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964288 00000100:00100000:1.0:1788530609.893877:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964288 00000100:00100000:1.0:1788530609.894213:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788530609.894225:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530609.894392:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964288:12345-0@lo:502:mount.lustre.0 Request processed in 169us (10918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.894401:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530609.905011:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f27480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530609.905059:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530609.905183:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 224 off10504 00000040:00080000:2.0:1788530609.905199:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788530609.908708:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530609.908722:0:24258:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788530609.908729:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.908732:0:24258:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788530609.908741:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530609.908759:0:24258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a9f32880000) 00000020:00000080:2.0:1788530609.908785:0:24258:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788530609.908792:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788530609.908916:0:24258:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0aaea000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788530609.908924:0:24258:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788530609.908930:0:24258:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e12575228d 00010000:00010000:3.0:1788530609.917908:0:24258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788530609.918850:0:24258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788530609.920201:0:24258:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788530609.923274:0:24258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788530609.923285:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530609.923290:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923292:0:24258:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788530609.923296:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788530609.923298:0:24258:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788530609.923299:0:24258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530609.923300:0:24258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530609.923302:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788530609.923304:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923305:0:24258:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788530609.923307:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530609.923310:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923311:0:24258:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788530609.923314:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788530609.923315:0:24258:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788530609.923317:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530609.923319:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923320:0:24258:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788530609.923328:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530609.923331:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923332:0:24258:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788530609.923335:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788530609.923363:0:24258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530609.923366:0:24258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530609.923367:0:24258:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788530609.923370:0:24258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 14 count 14 00000020:01000000:2.0:1788530609.923737:0:24241:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788530609.923750:0:24241:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788530609.923771:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575227f expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.923783:0:24241:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140800/0xb28d70e125752278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575227f expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530609.923791:0:24241:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaea000 from 1 10000000:01000000:2.0:1788530609.923794:0:24241:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530609.923838:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.923855:0:24241:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.923867:0:24241:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.923899:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530609.923963:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.924013:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530609.924120:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964416 00000100:00100000:1.0:1788530609.924128:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964416 00000100:00100000:1.0:1788530609.924176:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788530609.924185:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:24241:x1875409555964416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530609.924197:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530609.924210:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752294 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.924233:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752294 expref: 22 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.924243:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752294 expref: 22 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530609.924251:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166000, rc 0) 00000100:00100000:1.0:1788530609.924288:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:24241:x1875409555964416:12345-0@lo:101:mount.lustre.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.924294:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530609.925088:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530609.925104:0:24241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.925114:0:24241:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.925732:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964544:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788530609.925781:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.925811:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.925970:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964544 00000100:00100000:3.0:1788530609.925976:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964544 00000100:00100000:3.0:1788530609.926020:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788530609.926030:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:24241:x1875409555964544:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788530609.926047:0:22734:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788530609.926066:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530609.926070:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530609.926073:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 12 00000100:00100000:3.0:1788530609.926149:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:24241:x1875409555964544:12345-0@lo:256:mount.lustre.0 Request processed in 120us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.926157:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788530609.926681:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964544:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788530609.927221:0:24241:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530609.927239:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927249:0:24241:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530609.927269:0:24241:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaea000 from 1 10000000:01000000:2.0:1788530609.927272:0:24241:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530609.927301:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927308:0:24241:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927316:0:24241:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530609.927330:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530609.927369:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.927390:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530609.927413:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964672 00000100:00100000:2.0:1788530609.927417:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964672 00000100:00100000:2.0:1788530609.927448:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530609.927456:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:24241:x1875409555964672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530609.927465:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530609.927476:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257522a2 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927494:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927505:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927524:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141400, rc 0) 00000100:00100000:2.0:1788530609.927589:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555964672:12345-0@lo:101:mount.lustre.0 Request processed in 134us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530609.927596:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530609.927632:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530609.927644:0:24241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530609.927653:0:24241:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530609.931925:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:2.0:1788530609.932389:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530609.932597:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788530609.932621:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:2.0:1788530609.932646:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:2.0:1788530609.932660:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:2.0:1788530609.932671:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:2.0:1788530609.932699:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:2.0:1788530609.932714:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:2.0:1788530609.932727:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:2.0:1788530609.932740:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:2.0:1788530609.932753:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:3.0:1788530609.932863:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:3.0:1788530609.932900:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:3.0:1788530609.932907:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:3.0:1788530609.933001:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530609.933065:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530609.933102:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530609.933576:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964800 00000100:00100000:2.0:1788530609.933584:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964800 00000100:00100000:2.0:1788530609.933631:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530609.933641:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555964800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.933776:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555964800:12345-0@lo:501:mount.lustre.0 Request processed in 135us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.933788:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530609.933789:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530609.933820:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530609.933869:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530609.933901:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.933920:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555964928 00000100:00100000:3.0:1788530609.933924:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555964928 00000100:00100000:3.0:1788530609.933950:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530609.933956:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555964928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530609.934089:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555964928:12345-0@lo:503:mount.lustre.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.934096:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530609.934133:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555964928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788530609.934481:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530609.934539:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530609.934601:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530609.934624:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.934638:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965056 00000100:00100000:3.0:1788530609.934641:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965056 00000100:00100000:3.0:1788530609.934659:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530609.934664:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555965056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530609.934743:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555965056:12345-0@lo:502:mount.lustre.0 Request processed in 78us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.934789:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530609.936642:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:0.0:1788530609.936685:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:0.0:1788530609.936700:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:0.0:1788530609.936712:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:0.0:1788530609.936723:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:0.0:1788530609.936735:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:0.0:1788530609.936746:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:0.0:1788530609.936760:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:0.0:1788530609.936773:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:0.0:1788530609.936787:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:0.0:1788530609.936801:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:0.0:1788530609.936860:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530609.936923:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530609.937051:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.937084:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965184 00000100:00100000:0.0:1788530609.937153:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965184 00000100:00100000:3.0:1788530609.944833:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530609.946024:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530609.946042:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555965184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530609.946323:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555965184:12345-0@lo:502:mount.lustre.0 Request processed in 287us (9398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.946331:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530609.946361:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530609.946449:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:1.0:1788530609.946462:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788530609.949864:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530609.949878:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.949881:0:24262:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788530609.949896:0:24262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0aaea000 00000020:00000080:2.0:1788530609.949899:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530609.949908:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530609.949911:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.949912:0:24262:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788530609.949914:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530609.949916:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.949917:0:24262:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788530609.949920:0:24262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0aaea000 00000020:00000080:2.0:1788530609.949923:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530609.950190:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530609.950194:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.950195:0:24262:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788530609.950197:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530609.950200:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.950201:0:24262:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530609.950205:0:24262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0aaea000 00000020:00000080:2.0:1788530609.950208:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530609.950225:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530609.950228:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.950229:0:24262:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530609.950231:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530609.950233:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.950234:0:24262:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788530609.950237:0:24262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0aaea000 00000020:00000080:2.0:1788530609.950246:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530609.950281:0:24262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530609.950285:0:24262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530609.950287:0:24262:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788530609.950290:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000020:01000000:3.0:1788530609.950443:0:24241:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788530609.950457:0:24241:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530609.950471:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.950492:0:24241:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530609.950541:0:24241:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530609.950556:0:24241:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f0aaea000 10000000:01000000:3.0:1788530609.950585:0:24241:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f0aaea000 10000000:01000000:3.0:1788530609.950591:0:24241:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530609.950615:0:24241:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530609.950673:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530609.950680:0:24241:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530609.950693:0:24241:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaea000 from 1 10000000:01000000:3.0:1788530609.950697:0:24241:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530609.950731:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.950739:0:24241:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.950751:0:24241:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530609.950772:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530609.950846:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530609.950894:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530609.950926:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965312 00000100:00100000:3.0:1788530609.950933:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965312 00000100:00100000:3.0:1788530609.951115:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530609.951124:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:24241:x1875409555965312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530609.951144:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530609.951155:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb000/0xb28d70e1257522b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257522b0 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.951178:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb000/0xb28d70e1257522b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257522b0 expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.951188:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb000/0xb28d70e1257522b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522b0 expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.951197:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb000, rc 0) 00000100:00100000:3.0:1788530609.951231:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965312:12345-0@lo:101:mount.lustre.0 Request processed in 108us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530609.951237:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530609.951284:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530609.951296:0:24241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522b7 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530609.951305:0:24241:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257522b7 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530609.962658:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000040:00080000:1.0:1788530609.962978:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530609.963202:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:1.0:1788530609.963227:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:1.0:1788530609.963242:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:1.0:1788530609.963273:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:1.0:1788530609.963290:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:1.0:1788530609.963303:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:1.0:1788530609.963318:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:1.0:1788530609.963331:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:1.0:1788530609.963345:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:1.0:1788530609.963359:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:1.0:1788530609.963374:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:1.0:1788530609.963388:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:1.0:1788530609.963402:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:1.0:1788530609.963415:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:1.0:1788530609.963429:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:1.0:1788530609.963443:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:1.0:1788530609.963457:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:1.0:1788530609.963470:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:1.0:1788530609.963484:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:1.0:1788530609.963511:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:1.0:1788530609.963526:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:1.0:1788530609.963541:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:1.0:1788530609.963555:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:1.0:1788530609.963604:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:1.0:1788530609.963620:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 160 off12472 00000040:00080000:1.0:1788530609.963634:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12696 00000040:00080000:1.0:1788530609.963649:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12920 00000040:00080000:1.0:1788530609.963662:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off13000 00000040:00080000:1.0:1788530609.963686:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13224 00000040:00080000:1.0:1788530609.963701:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13448 00000040:00080000:1.0:1788530609.963715:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13536 00000040:00080000:1.0:1788530609.963729:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13664 00000040:00080000:1.0:1788530609.963744:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13808 00000040:00080000:1.0:1788530609.963758:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13936 00000040:00080000:1.0:1788530609.963772:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14160 00000040:00080000:1.0:1788530609.963798:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14384 00000040:00080000:1.0:1788530609.963814:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14464 00000040:00080000:1.0:1788530609.963841:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14688 00000040:00080000:1.0:1788530609.963856:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14912 00000040:00080000:1.0:1788530609.963869:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 88 off15000 00000040:00080000:1.0:1788530609.963884:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 128 off15128 00000040:00080000:1.0:1788530609.963897:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 144 off15272 00000040:00080000:1.0:1788530609.963912:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 128 off15400 00000040:00080000:1.0:1788530609.963926:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 224 off15624 00000040:00080000:1.0:1788530609.963940:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off15848 00000040:00080000:1.0:1788530609.963954:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].46, 80 off15928 00000040:00080000:1.0:1788530609.963968:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].47, 224 off16152 00000040:00080000:1.0:1788530609.963983:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].48, 232 off16384 00000040:00080000:1.0:1788530609.964092:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].49, 224 off16608 00000040:00080000:1.0:1788530609.964111:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].50, 120 off16728 00000040:00080000:1.0:1788530609.964141:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].51, 224 off16952 00000040:00080000:1.0:1788530609.964148:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 51 count 51 00000100:00100000:1.0:1788530609.964236:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530609.964302:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530609.964345:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.964595:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965440 00000100:00100000:0.0:1788530609.964602:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965440 00000100:00100000:0.0:1788530609.964648:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530609.964663:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530609.964780:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965440:12345-0@lo:501:mount.lustre.0 Request processed in 118us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.964788:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530609.967346:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530609.967404:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530609.967473:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530609.967557:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.977234:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965568 00000100:00100000:0.0:1788530609.977249:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965568 00000100:00100000:0.0:1788530609.977312:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530609.977322:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530609.977503:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965568:12345-0@lo:503:mount.lustre.0 Request processed in 182us (10029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.977510:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530609.978164:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788530609.978656:0:24241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530609.978746:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530609.978796:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530609.978843:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18626e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.980219:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965696 00000100:00100000:0.0:1788530609.980229:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965696 00000100:00100000:0.0:1788530609.980273:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530609.980282:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530609.980417:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965696:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.980424:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530609.980792:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530609.982656:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:2.0:1788530609.982708:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:2.0:1788530609.982724:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:2.0:1788530609.982738:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:2.0:1788530609.982751:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:2.0:1788530609.982762:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:2.0:1788530609.982776:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:2.0:1788530609.982790:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:2.0:1788530609.982805:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:2.0:1788530609.982820:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:2.0:1788530609.983388:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:2.0:1788530609.983402:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:2.0:1788530609.983414:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:2.0:1788530609.983427:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:2.0:1788530609.983440:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:2.0:1788530609.983452:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:2.0:1788530609.983463:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:2.0:1788530609.983476:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:2.0:1788530609.983488:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:2.0:1788530609.983501:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:2.0:1788530609.983514:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:2.0:1788530609.983525:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:2.0:1788530609.983539:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:2.0:1788530609.983552:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:2.0:1788530609.983587:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 160 off12472 00000040:00080000:2.0:1788530609.983617:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12696 00000040:00080000:2.0:1788530609.983640:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12920 00000040:00080000:2.0:1788530609.983653:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off13000 00000040:00080000:2.0:1788530609.983667:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13224 00000040:00080000:2.0:1788530609.983680:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13448 00000040:00080000:2.0:1788530609.983693:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13536 00000040:00080000:2.0:1788530609.983705:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13664 00000040:00080000:2.0:1788530609.983718:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13808 00000040:00080000:2.0:1788530609.983730:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13936 00000040:00080000:2.0:1788530609.983742:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14160 00000040:00080000:2.0:1788530609.983754:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14384 00000040:00080000:2.0:1788530609.983765:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14464 00000040:00080000:2.0:1788530609.983776:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14688 00000040:00080000:2.0:1788530609.983788:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14912 00000040:00080000:2.0:1788530609.983800:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 88 off15000 00000040:00080000:2.0:1788530609.983811:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 128 off15128 00000040:00080000:2.0:1788530609.983848:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 144 off15272 00000040:00080000:2.0:1788530609.983863:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 128 off15400 00000040:00080000:2.0:1788530609.983874:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 224 off15624 00000040:00080000:2.0:1788530609.983885:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off15848 00000040:00080000:2.0:1788530609.983896:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].46, 80 off15928 00000040:00080000:2.0:1788530609.983906:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].47, 224 off16152 00000040:00080000:2.0:1788530609.983916:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].48, 232 off16384 00000100:00100000:2.0:1788530609.987230:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530609.987317:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.987356:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.987689:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965824 00000100:00100000:0.0:1788530609.987698:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965824 00000100:00100000:0.0:1788530609.987752:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530609.987761:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530609.987907:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965824:12345-0@lo:502:mount.lustre.0 Request processed in 147us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.987916:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788530609.988908:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530609.989347:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].49, 224 off16608 00000040:00080000:2.0:1788530609.989376:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].50, 120 off16728 00000100:00100000:2.0:1788530609.989411:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530609.989469:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530609.989511:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530609.989644:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555965952 00000100:00100000:0.0:1788530609.989656:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555965952 00000100:00100000:0.0:1788530609.989696:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530609.989704:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530609.989797:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555965952:12345-0@lo:502:mount.lustre.0 Request processed in 93us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530609.989804:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788530609.989924:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555965952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530609.989977:0:24241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].51, 224 off16952 00000040:00080000:2.0:1788530609.989985:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788530609.992306:0:24267:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788530609.992324:0:24267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a9f32886620) 00000020:00000080:2.0:1788530609.992349:0:24267:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788530609.992449:0:24267:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0aaea000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788530609.992454:0:24267:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0aaea000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788530609.992457:0:24267:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0aaea000 3 00010000:00080000:2.0:1788530609.992489:0:24267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e03717800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530609.995163:0:24267:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788530609.995344:0:24267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788530609.995383:0:24267:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788530609.995395:0:24267:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb28d70e1257522c5 00000100:00080000:2.0:1788530609.995405:0:24267:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530609.995410:0:24267:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e03717800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530609.995442:0:24267:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37376a00 x1875409555966080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530609.995473:0:24267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788530609.995606:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555966080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788530609.995673:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530609.996187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530609.996196:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530609.996199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530609.996202:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530609.996239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530609.996242:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530609.996244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530609.996247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788530609.996291:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555966336:0@lo:400:kworker.0 00000100:00100000:1.0:1788530609.996320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530609.996344:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530609.996349:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555966208:0@lo:400:kworker.0 00000100:00100000:1.0:1788530609.996373:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530609.996403:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966080 00000100:00100000:1.0:1788530609.996409:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966080 00000100:00100000:1.0:1788530609.996428:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966336 00000100:00100000:1.0:1788530609.996431:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966336 00000100:00100000:1.0:1788530609.996448:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966208 00000100:00100000:1.0:1788530609.996451:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966208 00000100:00100000:1.0:1788530609.996464:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530609.996471:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555966336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530609.996518:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555966336:12345-0@lo:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.996525:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530609.996538:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530609.996543:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555966208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530609.996592:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555966208:12345-0@lo:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.996598:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530609.996609:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530609.996613:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555966080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788530609.996632:0:22742:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 817 last 0 00000020:00000080:1.0:1788530609.996658:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb28d70e1257522cc 00000004:00100000:1.0:1788530609.996672:0:22742:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788530609.996709:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9a9f34573800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530609.996744:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875409555966080:12345-0@lo:38:llog_process_th.0 Request processed in 129us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530609.996750:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788530609.996784:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3df92d80 x1875409555966208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530609.996797:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555966208:0@lo:400:kworker.0 00010000:00080000:1.0:1788530609.996807:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3df93b80 x1875409555966336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530609.996814:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555966336:0@lo:400:kworker.0 00010000:00080000:1.0:1788530609.996870:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f37376a00 x1875409555966080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530609.996877:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530609.996884:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788530609.996891:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530609.996894:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530609.996897:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e03717800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530609.996901:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555966080:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788530609.997298:0:24267:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788530609.997314:0:24267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a9f2c14e620) 00000020:00000080:1.0:1788530609.997331:0:24267:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788530609.997408:0:24267:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0aaea000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788530609.997412:0:24267:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0aaea000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788530609.997415:0:24267:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0aaea000 3 00010000:00080000:1.0:1788530609.997452:0:24267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f34570000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530610.005923:0:24267:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788530610.006915:0:24267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788530610.006983:0:24267:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530610.006999:0:24267:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb28d70e1257522da 00000100:00080000:0.0:1788530610.007010:0:24267:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530610.007017:0:24267:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a9f34570000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530610.007056:0:24267:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3960ea00 x1875409555966464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530610.007085:0:24267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788530610.007369:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555966464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530610.007443:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788530610.007610:0:24267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000100:00100000:0.0:1788530610.007830:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966464 00000100:00100000:0.0:1788530610.007838:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966464 00000100:00100000:0.0:1788530610.007876:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530610.007883:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555966464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788530610.007910:0:22742:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 817 last 0 00000020:00000080:0.0:1788530610.008073:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb28d70e1257522e1 00000004:00100000:0.0:1788530610.008143:0:22742:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530610.008172:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9a9f36096000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530610.008222:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875409555966464:12345-0@lo:38:llog_process_th.0 Request processed in 339us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530610.008235:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788530610.008305:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3960ea00 x1875409555966464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530610.008315:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530610.008322:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788530610.008328:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530610.008332:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788530610.008334:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f34570000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530610.008339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555966464:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788530610.009108:0:24241:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788530610.009137:0:24241:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530610.009161:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522b7 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530610.009172:0:24241:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e1257522b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522b7 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788530610.009232:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788530610.009234:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530610.009235:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530610.009237:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530610.009238:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530610.009239:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530610.009241:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530610.009242:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530610.009243:0:24241:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530610.009247:0:24241:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788530610.009249:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530610.009251:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530610.009252:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530610.009253:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530610.009254:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530610.009255:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530610.009256:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530610.009257:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530610.009258:0:24241:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530610.009277:0:24241:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788530610.009290:0:24241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555966592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788530610.009337:0:24241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530610.009356:0:24241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530610.009375:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966592 00000100:00100000:0.0:1788530610.009385:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966592 00000100:00100000:0.0:1788530610.009425:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530610.009432:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:24241:x1875409555966592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788530610.009466:0:22734:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788530610.009478:0:22734:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1788530610.010998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530610.011009:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530610.011012:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530610.011014:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530610.011018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530610.011021:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530610.011023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530610.011027:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:1.0:1788530610.012918:0:22734:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788530610.012941:0:22734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788530610.013180:0:22757:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788530610.013185:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788530610.013206:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013225:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575220f expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013234:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013248:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752294 expref: 24 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013256:0:22757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013291:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 24 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013304:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 24 pid: 22733 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530610.013317:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966720:0@lo:104: 00000100:00100000:2.0:1788530610.013376:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530610.013420:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013428:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530610.013435:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966848:0@lo:104: 00000100:00100000:2.0:1788530610.013457:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530610.013474:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530610.013481:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 24 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530610.013488:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966976:0@lo:104: 00000100:00100000:2.0:1788530610.013510:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530610.013606:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788530610.013624:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530610.013646:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966720 00000100:00100000:1.0:1788530610.013652:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966720 00000100:00100000:1.0:1788530610.013685:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966848 00000100:00100000:1.0:1788530610.013688:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966848 00000100:00100000:1.0:1788530610.013698:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555966976 00000100:00100000:1.0:1788530610.013700:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555966976 00000100:00100000:1.0:1788530610.013711:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530610.013718:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22757:x1875409555966720:12345-0@lo:104: 00010000:00010000:1.0:1788530610.013730:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.013791:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530610.013796:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22757:x1875409555966720:12345-0@lo:104: Request processed in 79us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.013803:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530610.013818:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530610.013835:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f341d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555966848:12345-0@lo:104: 00010000:00010000:1.0:1788530610.013841:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.013867:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530610.013871:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f341d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555966848:12345-0@lo:104: Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.013876:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530610.013905:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530610.013911:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555966976:12345-0@lo:104: 00010000:00010000:1.0:1788530610.013919:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014213:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788530610.014219:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555966976:12345-0@lo:104: Request processed in 308us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.014225:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530610.014262:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966720:0@lo:104: 00000100:00100000:1.0:1788530610.014270:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966848:0@lo:104: 00000100:00100000:1.0:1788530610.014275:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555966976:0@lo:104: 00010000:00010000:1.0:1788530610.014292:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014306:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530610.014311:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014317:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530610.014320:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014328:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530610.014334:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530610.014339:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530610.014366:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014382:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530610.014610:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014617:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125752294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575229b expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014629:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530610.014631:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014637:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530610.014639:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014646:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530610.014652:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530610.014657:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530610.014672:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014677:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530610.014683:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014689:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166a00/0xb28d70e12575221d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752224 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014705:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530610.014708:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014714:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530610.014717:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014724:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530610.014732:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530610.014737:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530610.014751:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014757:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530610.014771:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014779:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575220f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752216 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.014791:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530610.014793:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530610.014795:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530610.014800:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530610.014838:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555967104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530610.014869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530610.014898:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530610.014904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555967232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530610.014926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530610.015080:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967104 00000100:00100000:0.0:1788530610.015086:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967104 00010000:00010000:0.0:1788530610.015117:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 25 pid: 22733 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530610.015140:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967232 00000100:00100000:0.0:1788530610.015142:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967232 00010000:00010000:0.0:1788530610.015153:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 26 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530610.015170:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530610.015176:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:3649:x1875409555967104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530610.015185:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530610.015190:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 26 pid: 22733 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530610.015199:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 26 pid: 22733 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530610.015211:0:23894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575229b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125752294 expref: 26 pid: 22733 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530610.015223:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530610.015253:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:3649:x1875409555967104:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.015297:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555967360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530610.015322:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530610.015356:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967360 00000100:00100000:1.0:1788530610.015359:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967360 00010000:00010000:1.0:1788530610.015371:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 26 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530610.015472:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:24241:x1875409555966592:12345-0@lo:253:mount.lustre.0 Request processed in 6039us (6134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530610.015481:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530610.022214:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530610.022378:0:24241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:24241:1875409555966592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530610.022395:0:24241:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788530610.022398:0:24241:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530610.022400:0:24241:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530610.022401:0:24241:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530610.022402:0:24241:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530610.022403:0:24241:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530610.022405:0:24241:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530610.022406:0:24241:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530610.022408:0:24241:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530610.022409:0:24241:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788530610.022424:0:24241:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788530610.023233:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530610.023247:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3649:x1875409555967232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530610.023262:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530610.023271:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023285:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023301:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140000/0xb28d70e125752224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575221d expref: 24 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023315:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530610.023375:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:3649:x1875409555967232:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (8447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.023382:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530610.023429:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530610.023434:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:3647:x1875409555967360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530610.023442:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530610.023447:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 22 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023455:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 22 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023464:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141600/0xb28d70e125752216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575220f expref: 22 pid: 22734 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023474:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023482:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530610.023496:0:22727:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017298453s 00010000:00010000:1.0:1788530610.023501:0:22727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023508:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023515:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023521:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023527:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530610.023537:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023545:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023576:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023586:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530610.023612:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:3647:x1875409555967360:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530610.023618:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530610.023651:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555967232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530610.023660:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555967104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530610.023683:0:22757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023691:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530610.023697:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140200/0xb28d70e1257522e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530610.023722:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555967360:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788530610.026598:0:24241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788530610.030140:0:24241:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788530610.030150:0:24241:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788530610.030190:0:24241:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788530610.030215:0:24241:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788530610.031001:0:24241:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530610.031214:0:24241:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788530610.118229:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530610.434404:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788530611.063286:0:24320:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530611.063676:0:24320:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530611.137463:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788530611.529100:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530611.529108:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaea000 from 13 10000000:01000000:2.0:1788530611.529114:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530611.529175:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.529187:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.529199:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530611.529227:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530611.529304:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530611.529360:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530611.534238:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967488 00000100:00100000:3.0:1788530611.534260:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967488 00000100:00100000:3.0:1788530611.534356:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530611.534368:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+21:22738:x1875409555967488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530611.534386:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530611.534406:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257522ef expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.534436:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257522ef expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.534450:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522ef expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.534459:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eaa00, rc 0) 00000100:00100000:3.0:1788530611.534552:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:22738:x1875409555967488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530611.534592:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530611.534681:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530611.534702:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.534712:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530611.534791:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788530611.534842:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530611.534876:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530611.536797:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967616 00000100:00100000:2.0:1788530611.536821:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967616 00000100:00100000:2.0:1788530611.536879:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788530611.536888:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:22738:x1875409555967616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530611.536922:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530611.536961:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530611.536964:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788530611.537081:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:22738:x1875409555967616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530611.537088:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788530611.537138:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530611.537179:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530611.537188:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537198:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530611.537213:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530611.537215:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03d6c000 from 13 10000000:01000000:2.0:1788530611.537218:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530611.537246:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537255:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537265:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530611.537282:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530611.537312:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530611.537339:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03f7d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788530611.537352:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967744 00000100:00100000:2.0:1788530611.537359:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967744 00000100:00100000:2.0:1788530611.537383:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530611.537389:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+22:22738:x1875409555967744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530611.537405:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530611.537416:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257522fd expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537435:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257522fd expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537445:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522fd expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530611.537455:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141200, rc 0) 00000100:00100000:2.0:1788530611.537493:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:22738:x1875409555967744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530611.537499:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788530611.537587:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530611.537600:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530611.537607:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530611.537645:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530611.537675:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530611.537693:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17635b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530611.537855:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555967872 00000100:00100000:2.0:1788530611.537860:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555967872 00000100:00100000:2.0:1788530611.537884:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788530611.537898:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:22738:x1875409555967872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530611.537909:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530611.537920:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530611.537922:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788530611.538011:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:22738:x1875409555967872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530611.538018:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788530611.538050:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555967872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530611.538118:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530611.538123:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530611.538131:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530611.538142:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530611.538143:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f3b266000 from 13 10000000:01000000:0.0:1788530611.538146:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530611.538165:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530611.538171:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530611.538177:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530611.538188:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555968000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530611.538212:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530611.538231:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17635b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530611.538365:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968000 00000100:00100000:3.0:1788530611.538370:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968000 00000100:00100000:3.0:1788530611.538406:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788530611.538413:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+23:22738:x1875409555968000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530611.538421:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530611.538429:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575230b expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.538445:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575230b expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.538453:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575230b expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.538460:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb200, rc 0) 00000100:00100000:3.0:1788530611.538493:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:22738:x1875409555968000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530611.538500:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788530611.538540:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555968000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530611.538551:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.538579:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530611.538620:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555968128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788530611.538648:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530611.538661:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530611.538673:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968128 00000100:00100000:3.0:1788530611.538676:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968128 00000100:00100000:3.0:1788530611.538693:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788530611.538698:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:22738:x1875409555968128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530611.538708:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530611.538718:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530611.538722:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788530611.538787:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:22738:x1875409555968128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530611.538794:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788530611.538834:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555968128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530611.538871:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530611.538877:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530611.538884:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530612.162996:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530613.184952:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530614.217735:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530614.337285:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530614.337306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555968256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530614.337382:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530614.341037:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968256 00000100:00100000:2.0:1788530614.341059:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968256 00000100:00100000:2.0:1788530614.341115:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530614.341126:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555968256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530614.341163:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530614.341239:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530614.341252:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555968256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530614.341254:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555968384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530614.341259:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530614.341443:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555968256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530614.344679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530614.345150:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968384 00000100:00100000:2.0:1788530614.345160:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968384 00000100:00100000:2.0:1788530614.345254:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530614.345264:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555968384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530614.345298:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788530614.345371:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555968384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530614.345378:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530614.345453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555968384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788530615.233730:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530615.364608:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788530615.372556:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530615.372584:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530615.372587:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530615.372589:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530615.372613:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530615.372616:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530615.372618:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530615.372621:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530615.372671:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555968512:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372736:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372782:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555969024:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372810:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530615.372842:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555968896:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372891:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555968640:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555969152:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372941:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372953:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788530615.372957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555968768:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.372972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.372985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555969280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373004:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530615.373030:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969024 00000100:00100000:0.0:1788530615.373036:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969024 00000100:00100000:0.0:1788530615.373067:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969152 00000100:00100000:0.0:1788530615.373070:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969152 00000100:00100000:0.0:1788530615.373103:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968768 00000100:00100000:0.0:1788530615.373106:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968768 00000100:00100000:0.0:1788530615.373114:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969280 00000100:00100000:0.0:1788530615.373116:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969280 00000100:00100000:0.0:1788530615.373131:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530615.373138:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555969024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373183:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555969024:12345-0@lo:400:kworker.0 Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373190:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530615.373206:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530615.373211:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555969152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373237:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555969152:12345-0@lo:400:kworker.0 Request processed in 26us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373242:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530615.373253:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530615.373260:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555968768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373283:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555968768:12345-0@lo:400:kworker.0 Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373288:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530615.373299:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530615.373310:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555969280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373337:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555969280:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373343:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530615.373362:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968896 00000100:00100000:0.0:1788530615.373366:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968896 00000100:00100000:0.0:1788530615.373380:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968640 00000100:00100000:0.0:1788530615.373390:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968640 00000100:00100000:0.0:1788530615.373406:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530615.373411:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555968896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373441:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555968896:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373447:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530615.373458:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530615.373463:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555968640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373487:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555968640:12345-0@lo:400:kworker.0 Request processed in 24us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530615.373493:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788530615.373536:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3960c380 x1875409555968768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530615.373549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555968768:0@lo:400:kworker.0 00010000:00080000:0.0:1788530615.373580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3960c000 x1875409555969280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530615.373588:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555969280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373597:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555968640:0@lo:400:kworker.0 00010000:00080000:0.0:1788530615.373605:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3960ea00 x1875409555969152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530615.373612:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555969152:0@lo:400:kworker.0 00000100:00100000:0.0:1788530615.373642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555968896:0@lo:400:kworker.0 00010000:00080000:0.0:1788530615.373651:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3960fb80 x1875409555969024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530615.373665:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555969024:0@lo:400:kworker.0 00000100:00080000:1.0:1788530615.373787:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530615.373793:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530615.377992:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555968512 00000100:00100000:3.0:1788530615.378008:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555968512 00000100:00100000:3.0:1788530615.378071:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788530615.378079:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3650:x1875409555968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530615.378167:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3650:x1875409555968512:12345-0@lo:400:kworker.0 Request processed in 89us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530615.378175:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788530615.378229:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555968512:0@lo:400:kworker.0 00010000:00010000:0.0:1788530616.263885:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530616.926918:0:24611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788530617.282105:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530618.068957:0:24663:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530618.070837:0:24663:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788530618.177626:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530603/real 1788530603] req@ffff9a9e0375ed80 x1875409555960704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530618.177657:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375ed80 x1875409555960704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530618.177668:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530603/real 1788530603] req@ffff9a9e0375dc00 x1875409555960832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530618.177680:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375dc00 x1875409555960832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530618.177718:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaed000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530618.177755:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530618.177760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555960704:0@lo:8:kworker.0 00000100:00080000:2.0:1788530618.177766:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530618.177772:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530618.177775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555960832:0@lo:8:kworker.0 00000100:00080000:3.0:1788530618.177939:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530618.177952:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530618.177955:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530618.177958:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530618.177984:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530618.177987:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788530618.177990:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaed000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530618.177995:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 810 00000100:00080000:3.0:1788530618.178015:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788530618.178022:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f0aaed000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530618.178041:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df93b80 x1875409555969920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530618.178065:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530618.178068:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530618.178070:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530618.178074:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 810 00000100:00080000:3.0:1788530618.178076:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788530618.178080:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530618.178091:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3df92d80 x1875409555970048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530618.178128:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555969664:0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178191:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.178222:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555970432:0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178251:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.178270:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530618.178276:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555969792:0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178305:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.178350:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969664 00000100:00100000:3.0:1788530618.178363:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969664 00000100:00100000:3.0:1788530618.178406:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970432 00000100:00100000:3.0:1788530618.178410:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970432 00000100:00100000:3.0:1788530618.178438:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530618.178458:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555969664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178517:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555969664:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.178525:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530618.178543:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530618.178555:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555970432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178617:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555970432:12345-0@lo:400:kworker.0 Request processed in 62us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.178624:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530618.178645:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969792 00000100:00100000:3.0:1788530618.178648:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969792 00000100:00100000:3.0:1788530618.178672:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530618.178678:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555969792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.178708:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555969792:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.178714:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788530618.178732:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530618.178760:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555969920:0@lo:8:kworker.0 00000100:00100000:3.0:1788530618.178788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.178815:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555970048:0@lo:8:kworker.0 00000100:00100000:3.0:1788530618.178840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.178871:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969920 00000100:00100000:3.0:1788530618.178875:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969920 00000100:00100000:3.0:1788530618.178888:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970048 00000100:00100000:3.0:1788530618.178891:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970048 00000100:00100000:3.0:1788530618.178900:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530618.178904:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555969920:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788530618.178941:0:24246:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:3.0:1788530618.178971:0:24246:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125752319 00002000:00100000:3.0:1788530618.178984:0:24246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a9e03ea8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788530618.178988:0:24246:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788530618.178995:0:24246:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530618.179162:0:24246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788530618.179183:0:24246:0:(import.c:65:import_set_state_nolock()) ffff9a9e03eae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530618.179220:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555969920:12345-0@lo:8:kworker.0 Request processed in 314us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.179226:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530618.179240:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530618.179243:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555970048:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788530618.179253:0:24246:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788530618.179276:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555970048:12345-0@lo:8:kworker.0 Request processed in 31us (435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530618.179281:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530618.179313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555969792:0@lo:400:kworker.0 00010000:00080000:3.0:1788530618.179325:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3df90700 x1875409555969664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530618.179335:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555969664:0@lo:400:kworker.0 00010000:00080000:3.0:1788530618.179345:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3df90e00 x1875409555970432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530618.179353:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555970432:0@lo:400:kworker.0 00010000:00080000:3.0:1788530618.179386:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3df93b80 x1875409555969920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530618.179393:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530618.179399:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788530618.179406:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788530618.179411:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788530618.179419:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaed000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788530618.179429:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788530618.179434:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555969920:0@lo:8:kworker.0 00000100:00080000:3.0:1788530618.179445:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530618.179449:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788530618.179452:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555970048:0@lo:8:kworker.0 00000100:00100000:1.0:1788530618.179765:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555969408:0@lo:400:kworker.0 00000100:00100000:1.0:1788530618.179801:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530618.179825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555970176:0@lo:400:kworker.0 00000100:00100000:1.0:1788530618.179847:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530618.179865:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530618.179872:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555969536:0@lo:400:kworker.0 00000100:00100000:1.0:1788530618.179893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530618.179909:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555970304:0@lo:400:kworker.0 00000100:00100000:1.0:1788530618.179928:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788530618.180055:0:23482:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788530618.180075:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970688:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788530618.180103:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530618.180121:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768540 going to sleep for 11 seconds 00000004:00080000:2.0:1788530618.180136:0:23481:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788530618.180206:0:23481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 826082644206ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788530618.180212:0:23481:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788530618.180237:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970688 00000100:00100000:2.0:1788530618.180242:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970688 00000100:00100000:2.0:1788530618.180275:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530618.180283:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23482:x1875409555970688:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788530618.180776:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555970560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530618.180806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530618.181933:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970560 00000100:00100000:2.0:1788530618.181955:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970560 00000100:00100000:2.0:1788530618.181997:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530618.182016:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875409555970560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530618.182041:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530618.182106:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875409555970560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.182113:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788530618.182183:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37375500 x1875409555970560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530618.182202:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555970560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530618.186227:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969408 00000100:00100000:3.0:1788530618.186242:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969408 00000100:00100000:3.0:1788530618.188218:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788530618.188237:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3649:x1875409555969408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530618.189812:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3649:x1875409555969408:12345-0@lo:400:kworker.0 Request processed in 1575us (10002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.189824:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788530618.190096:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555969536 00000100:00100000:2.0:1788530618.190107:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555969536 00000100:00100000:2.0:1788530618.190152:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530618.190161:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555969536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530618.190221:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555969536:12345-0@lo:400:kworker.0 Request processed in 61us (10326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.190227:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530618.190260:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970176 00000100:00100000:2.0:1788530618.190265:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970176 00000100:00100000:2.0:1788530618.190288:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970304 00000100:00100000:2.0:1788530618.190291:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970304 00000100:00100000:2.0:1788530618.190312:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530618.190319:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555970176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530618.190349:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555970176:12345-0@lo:400:kworker.0 Request processed in 30us (10500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.190356:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530618.190367:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530618.190373:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555970304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530618.190397:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555970304:12345-0@lo:400:kworker.0 Request processed in 24us (10468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.190401:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530618.190652:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555969536:0@lo:400:kworker.0 00010000:00080000:0.0:1788530618.190673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3df92680 x1875409555970304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530618.190685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555970304:0@lo:400:kworker.0 00000100:00100000:0.0:1788530618.190697:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555969408:0@lo:400:kworker.0 00010000:00080000:0.0:1788530618.190707:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3df91180 x1875409555970176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530618.190716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555970176:0@lo:400:kworker.0 00000100:00080000:2.0:1788530618.192418:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530618.192426:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788530618.194719:0:23473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788530618.197497:0:24246:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788530618.197515:0:24246:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788530618.197628:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23482:x1875409555970688:12345-0@lo:7:osp-pre-0-1.0 Request processed in 17341us (17519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.197638:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788530618.199361:0:23482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37375180 x1875409555970688/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530634 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530618.199379:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970688:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788530618.199395:0:23482:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788530618.199438:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970816:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788530618.199490:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530618.199522:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530618.200942:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970816 00000100:00100000:2.0:1788530618.200952:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970816 00000100:00100000:2.0:1788530618.201012:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530618.201022:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23482:x1875409555970816:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788530618.201052:0:24248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788530618.201122:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23482:x1875409555970816:12345-0@lo:5:osp-pre-0-1.0 Request processed in 101us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530618.201130:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788530618.201226:0:23482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e7480 x1875409555970816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530634 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530618.201240:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970816:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788530618.201253:0:23482:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788530618.201303:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970944:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788530618.201351:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530618.201486:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530618.207840:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555970944 00000100:00100000:2.0:1788530618.207856:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555970944 00000100:00100000:2.0:1788530618.207925:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530618.207936:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23482:x1875409555970944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788530618.207980:0:24246:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1788530618.260780:0:24242:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788530618.260796:0:24242:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788530618.261011:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23482:x1875409555970944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 53073us (59654us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788530618.261022:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788530618.261216:0:23482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f33afd500 x1875409555970944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530634 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530618.261230:0:23482:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788530618.261235:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23482:1875409555970944:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788530618.261250:0:23482:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788530618.261310:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23482:1875409555971072:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788530618.261347:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530618.261385:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f176353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530618.261481:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971072 00000100:00100000:3.0:1788530618.261494:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971072 00000100:00100000:3.0:1788530618.261550:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530618.261581:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23482:x1875409555971072:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788530618.261641:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23482:x1875409555971072:12345-0@lo:900:osp-pre-0-1.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530618.261648:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788530618.262209:0:23482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92f100 x1875409555971072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530634 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530618.262220:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23482:1875409555971072:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788530618.306699:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530619.068250:0:24713:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530619.068494:0:24713:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530619.330341:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530619.459908:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555971200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530619.459979:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530619.460049:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971200 00000100:00100000:0.0:1788530619.460057:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971200 00000100:00100000:0.0:1788530619.460105:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530619.460114:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555971200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530619.460149:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788530619.460195:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555971200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530619.460203:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530619.460250:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555971200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530619.462021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555971328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530619.462075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530619.462606:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971328 00000100:00100000:0.0:1788530619.462613:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971328 00000100:00100000:0.0:1788530619.462653:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530619.462661:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555971328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530619.462691:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530619.465036:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555971328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2365us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530619.465049:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788530619.470020:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555971328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530620.352667:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530620.675051:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530621.390456:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530622.401759:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530623.297211:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530603/real 1788530603] req@ffff9a9e0375ce00 x1875409555960192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530623.297245:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375ce00 x1875409555960192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530623.297257:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530603/real 1788530603] req@ffff9a9e0375e300 x1875409555960320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530623.297269:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e0375e300 x1875409555960320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788530623.297289:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530623.297317:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788530623.297321:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555960192:0@lo:8:kworker.0 00000100:00080000:3.0:1788530623.297327:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530623.297333:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788530623.297335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555960320:0@lo:8:kworker.0 00000100:00080000:2.0:1788530623.297788:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530623.297793:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788530623.297795:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530623.297801:0:476:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 810 00000100:00080000:2.0:1788530623.297806:0:476:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788530623.297813:0:476:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e01aa1000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530623.297832:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37374e00 x1875409555971712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530623.297860:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530623.297863:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530623.297864:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530623.297867:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 810 00000100:00080000:2.0:1788530623.297870:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788530623.297873:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530623.297884:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555971712:0@lo:8:kworker.0 00000100:00100000:2.0:1788530623.297947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.298025:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37377800 x1875409555971840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530623.298166:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555971456:0@lo:400:kworker.0 00000100:00100000:3.0:1788530623.298203:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530623.298226:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530623.298241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555971584:0@lo:400:kworker.0 00000100:00100000:3.0:1788530623.298267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530623.298634:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971712 00000100:00100000:1.0:1788530623.298642:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971712 00000100:00100000:1.0:1788530623.298678:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530623.298685:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555971712:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788530623.298723:0:24248:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 831 last 0 00000020:00000080:1.0:1788530623.298753:0:24248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125752320 00002000:00100000:1.0:1788530623.298767:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a9f34570800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788530623.298771:0:24248:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788530623.298774:0:24248:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788530623.298839:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530623.298860:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9a9f34572000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530623.298903:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555971712:12345-0@lo:8:kworker.0 Request processed in 217us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530623.298910:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530623.303017:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971456 00000100:00100000:3.0:1788530623.303033:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971456 00000100:00100000:3.0:1788530623.303269:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530623.303281:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3647:x1875409555971456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530623.303358:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:3647:x1875409555971456:12345-0@lo:400:kworker.0 Request processed in 80us (5154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530623.303366:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530623.304207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555971456:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.304327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555971840:0@lo:8:kworker.0 00000100:00100000:2.0:1788530623.304375:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530623.304443:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37374e00 x1875409555971712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.304455:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530623.304466:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788530623.304475:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788530623.304481:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788530623.304484:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01aa1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788530623.304497:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788530623.312739:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555971712:0@lo:8:kworker.0 00000100:00100000:2.0:1788530623.312809:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971584 00000100:00100000:2.0:1788530623.312818:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971584 00000100:00100000:2.0:1788530623.312873:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530623.312893:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555971584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.312999:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555971584:12345-0@lo:400:kworker.0 Request processed in 108us (14730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.313007:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530623.313034:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971840 00000100:00100000:2.0:1788530623.313038:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971840 00000100:00100000:2.0:1788530623.313058:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530623.313063:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555971840:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788530623.313082:0:24246:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788530623.313119:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555971840:12345-0@lo:8:kworker.0 Request processed in 54us (8744us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530623.313126:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788530623.313181:0:22766:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788530623.313204:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22766:1875409555972096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788530623.313239:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.313259:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530623.313277:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555971968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530623.313303:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.313332:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555971968 00000100:00100000:2.0:1788530623.313336:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555971968 00000100:00100000:2.0:1788530623.313371:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530623.313378:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555971968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530623.313399:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530623.313436:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555971968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.313442:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788530623.313466:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530623.313498:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37374e00 x1875409555971968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.313517:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555971968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530623.313545:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555971584:0@lo:400:kworker.0 00000100:00080000:2.0:1788530623.313599:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530623.313604:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530623.313608:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555971840:0@lo:8:kworker.0 00000100:00100000:2.0:1788530623.313641:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530623.313647:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555972224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.313672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.313732:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972224 00000100:00100000:2.0:1788530623.313736:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972224 00000100:00100000:2.0:1788530623.313765:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530623.313771:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.313807:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555972224:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.313813:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788530623.313839:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37377800 x1875409555972224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.313847:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555972224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.313876:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555972352:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.313900:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.313925:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972352 00000100:00100000:2.0:1788530623.313934:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972352 00000100:00100000:2.0:1788530623.313957:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530623.313963:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555972352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.313997:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555972352:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.314004:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530623.314029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555972352:0@lo:400:kworker.0 00000100:00080000:2.0:1788530623.314053:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530623.314057:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530623.314059:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530623.314064:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 826 00000100:00080000:2.0:1788530623.314068:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788530623.314073:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530623.314079:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530623.314085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555972480:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.314109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.314132:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972096 00000100:00100000:2.0:1788530623.314136:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972096 00000100:00100000:2.0:1788530623.314152:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972480 00000100:00100000:2.0:1788530623.314155:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972480 00000100:00100000:2.0:1788530623.314174:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530623.314179:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555972480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.314212:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555972480:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.314218:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530623.314230:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530623.314236:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22766:x1875409555972096:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788530623.314455:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530623.314474:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37377800 x1875409555972480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.314484:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555972480:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.314514:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37377800 x1875409555972608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530623.314531:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555972608:0@lo:8:kworker.0 00000100:00100000:2.0:1788530623.314592:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.314631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555972736:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.314654:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.314741:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972736 00000100:00100000:2.0:1788530623.314745:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972736 00000100:00100000:2.0:1788530623.314767:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788530623.314774:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555972736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.314809:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555972736:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.314815:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788530623.315391:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37375880 x1875409555972736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.315403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555972736:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.315439:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530623.315445:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555972864:0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.315478:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.315504:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972864 00000100:00100000:2.0:1788530623.315514:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972864 00000100:00100000:2.0:1788530623.315546:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530623.315552:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555972864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530623.315609:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555972864:12345-0@lo:400:kworker.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.315616:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788530623.315632:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788530623.315649:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37375880 x1875409555972864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530623.315679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555972864:0@lo:400:kworker.0 00002000:00080000:2.0:1788530623.315693:0:24246:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000100:00100000:3.0:1788530623.316106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555972992:0@lo:400:kworker.0 00000100:00100000:3.0:1788530623.316138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530623.316172:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972992 00000100:00100000:3.0:1788530623.316176:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972992 00000100:00100000:3.0:1788530623.316206:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788530623.316213:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555972992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530623.316248:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555972992:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530623.316255:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788530623.316279:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e5f80 x1875409555972992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530623.316289:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555972992:0@lo:400:kworker.0 00000100:00080000:3.0:1788530623.316309:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788530623.316658:0:22765:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530623.316753:0:22765:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 831219192167ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788530623.316760:0:22765:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788530623.316795:0:24247:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788530623.316803:0:24247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788530623.316926:0:24248:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788530623.316939:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555972608 00000100:00100000:1.0:1788530623.316943:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555972608 00000100:00100000:1.0:1788530623.317045:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530623.317052:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555972608:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530623.317071:0:24899:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530623.317116:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555972608:12345-0@lo:8:kworker.0 Request processed in 63us (2523us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530623.317123:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788530623.325405:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530623.325419:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530623.325424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555972608:0@lo:8:kworker.0 00000004:00080000:0.0:1788530623.328861:0:22721:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788530623.329857:0:24246:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788530623.329870:0:24246:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:2.0:1788530623.346947:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.346959:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.347033:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.347038:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.347046:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.347064:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.347076:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.347097:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.347121:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530623.348119:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530623.348128:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.348138:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530623.348143:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.348153:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.348174:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.348181:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc01b6b/0xb28d70e125752327 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.348212:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.348214:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.348216:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.350452:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.350467:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.350490:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.350494:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.350501:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.350516:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.350526:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.350534:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.350554:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.351430:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.351439:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.351450:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.351456:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.351466:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.351496:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.351504:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575232e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.351522:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.351524:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.351526:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.352754:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.352765:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.352779:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.352784:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.352790:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.352802:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.352811:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.352819:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.352852:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530623.353691:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530623.353708:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.353718:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530623.353723:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.353732:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.353748:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.353756:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125752335 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.353774:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.353776:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.353777:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.353949:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.353955:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.353975:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.353979:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.353984:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.353994:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354002:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354010:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354025:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530623.354400:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.354406:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354414:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.354423:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.354428:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354438:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354446:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354452:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.354471:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530623.355286:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530623.355302:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355312:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530623.355316:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355325:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355341:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355349:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e12575233c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355368:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530623.355372:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355379:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530623.355382:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355390:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355414:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355422:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003332d97d/0xb28d70e125752343 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355435:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.355437:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.355439:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.355628:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.355634:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355644:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.355647:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.355652:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355661:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355670:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355676:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355712:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530623.355720:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530623.355724:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355730:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530623.355733:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355740:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355751:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355759:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e12575234a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.355773:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.355775:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.355776:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.356230:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.356237:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356246:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.356255:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.356260:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356270:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356278:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356285:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356305:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.356520:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.356526:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.356534:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.356538:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.356546:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.356575:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.356608:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eea9849/0xb28d70e125752351 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.356624:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.356626:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.356627:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.356754:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.356760:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356769:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.356773:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.356777:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356786:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356794:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356809:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.356830:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530623.357093:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.357099:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.357107:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.357111:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.357114:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.357122:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.357130:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.357138:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.357148:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788530623.358847:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.358858:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.358880:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.358883:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.358889:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.358899:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.358908:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.358915:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.358926:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788530623.359260:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788530623.359267:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359276:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.359280:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359290:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359306:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359313:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125752358 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359329:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530623.359333:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359347:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ba00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.359350:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359358:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359368:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359376:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d28fa8/0xb28d70e12575235f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359389:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.359392:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359399:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ac00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.359402:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359410:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359419:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359432:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9f6c68/0xb28d70e125752366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.359445:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.359447:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.359449:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.360722:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.362203:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.362214:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.362230:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.362236:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.362242:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.362255:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.362283:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.362291:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.362311:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.362795:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.362802:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.362811:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.362815:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.362824:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.362839:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.362847:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf81c4e/0xb28d70e12575236d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.362867:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.362869:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.362871:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.365740:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.365755:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.365774:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.365779:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.365786:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.365799:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.365810:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.365817:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.365848:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530623.369163:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.369177:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369194:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.369199:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.369206:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369220:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369229:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369237:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369261:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788530623.369713:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.369720:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369729:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.369732:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.369737:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369758:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369767:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369775:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.369784:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788530623.370145:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.370151:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.370160:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.370163:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.370167:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.370175:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.370182:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.370200:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.370209:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788530623.370765:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530623.370774:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370795:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36be00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.370799:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370809:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370827:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370834:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644c7c24/0xb28d70e125752374 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370852:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530623.370856:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370862:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.370865:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370872:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370880:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370891:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a65618c/0xb28d70e12575237b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370902:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530623.370906:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370912:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.370915:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370923:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370931:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370938:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125752382 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370946:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530623.370949:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370955:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.370973:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370982:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370991:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.370998:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e13e4ac6/0xb28d70e125752389 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371009:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.371011:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.371013:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.371160:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.371166:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371174:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.371177:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.371182:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371192:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371200:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371207:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371230:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530623.371726:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530623.371733:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371740:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.371743:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371751:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371765:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371779:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e125752390 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.371796:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.371798:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.371800:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.371920:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.371926:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371941:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.371944:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.371950:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.371960:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.373138:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.373148:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.373173:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530623.375334:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530623.375347:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.375359:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530623.375364:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.375375:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.375394:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.375402:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d133f55a/0xb28d70e125752397 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.375427:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.375428:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.375430:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.376404:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.376704:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.376714:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376729:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.376733:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.376740:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376754:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376776:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376784:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376803:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.376814:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.376818:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376826:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.376830:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376838:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376852:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376859:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db00bf6e/0xb28d70e12575239e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.376875:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.376885:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.376886:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530623.381552:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530623.381741:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.381758:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=831s v=(0 0) 00010000:00010000:3.0:1788530623.381763:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530623.381769:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.381782:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.381792:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.381800:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.381824:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530623.381872:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530623.381881:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.381891:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530623.381897:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.381907:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.381926:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.381935:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd0adfa/0xb28d70e1257523a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.381955:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.381958:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530623.381960:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.384964:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.384978:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.385007:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.385012:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.385019:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.385034:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.385051:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.385060:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.385080:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.387191:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.387205:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.387219:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.387223:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.387248:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.387268:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.387276:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025edc461/0xb28d70e1257523ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.387297:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.387299:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.387301:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.390190:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.390204:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.390223:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.390227:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.390233:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.390248:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.390273:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.390281:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.390304:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.391069:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.391076:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.391086:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.391091:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.391102:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.391121:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.391142:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e1257523b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.391163:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.391165:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.391167:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.391174:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.391192:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391202:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.391206:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.391211:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391222:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391231:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391239:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391269:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530623.391650:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.391656:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391665:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.391668:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.391672:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391682:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391691:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391710:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.391721:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788530623.392020:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.392026:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392035:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.392044:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.392049:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392060:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392069:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392077:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392086:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788530623.392093:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788530623.392101:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392111:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36bc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.392115:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392125:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392138:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392147:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c2d52d3/0xb28d70e1257523ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392163:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530623.392167:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392182:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.392185:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392194:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392205:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392212:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e1257523c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392225:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.392228:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392235:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.392238:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392245:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392255:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392270:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e1257523c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392284:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.392286:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.392287:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.392292:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.392505:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.392512:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392521:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.392524:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.392528:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392538:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392547:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392588:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.392604:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.392831:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.392836:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392844:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.392847:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392855:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392867:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392875:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e1257523cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.392889:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.392891:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.392899:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530623.393049:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530623.393055:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393064:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=831s v=(0 0) 00010000:00010000:0.0:1788530623.393068:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530623.393072:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393083:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393091:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393099:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393117:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.393277:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.393282:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.393289:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.393292:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.393299:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.393310:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.393318:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e87cbf31/0xb28d70e1257523d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.393331:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.393333:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.393335:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530623.393495:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530623.393505:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393514:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=831s v=(0 0) 00010000:00010000:0.0:1788530623.393517:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530623.393521:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393530:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393537:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393543:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.393853:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530623.394940:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530623.394949:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.396533:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=831s v=(0 0) 00010000:00010000:1.0:1788530623.396539:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530623.396546:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.396574:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.396587:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.396606:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396710:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530623.396717:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396725:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.396729:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396752:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396769:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396777:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2682ce2/0xb28d70e1257523dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396798:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.396801:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396807:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02da00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.396810:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396817:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396826:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.396835:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.396837:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.396844:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.397100:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788530623.397106:0:24246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000204c8cc7/0xb28d70e1257523e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.397439:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530623.398866:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530623.398877:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.398892:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=831s v=(0 0) 00010000:00010000:1.0:1788530623.398897:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530623.398903:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.398930:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.398941:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.398949:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.398976:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530623.399612:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530623.399621:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.399631:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530623.399636:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.399646:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.399669:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.399678:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781f398/0xb28d70e1257523eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.399693:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.399705:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530623.399707:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530623.399915:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530623.399922:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.399933:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=831s v=(0 0) 00010000:00010000:2.0:1788530623.399936:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530623.399942:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.399952:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.399961:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.399969:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530623.399988:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.400027:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530623.400034:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.400044:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.400049:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.400059:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.400071:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.400080:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2f93833/0xb28d70e1257523f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.400097:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.400099:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.400101:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530623.402493:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530623.402507:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.402523:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=831s v=(0 0) 00010000:00010000:0.0:1788530623.402527:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530623.402533:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.402545:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.402554:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.402579:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.402625:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530623.403100:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530623.403108:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.403118:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530623.403124:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.403134:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788530623.403143:0:24246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530623.403150:0:24246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.403152:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530623.403173:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f7c0bf4/0xb28d70e1257523f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.403173:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=831s v=(0 0) 00010000:00010000:0.0:1788530623.403178:0:24246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530623.403183:0:24246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.403193:0:24246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.403202:0:24246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.403209:0:24246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530623.403229:0:24246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530623.403423:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1788530623.403520:0:24246:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:3.0:1788530623.403611:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.403619:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.403627:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530623.403637:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.403646:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.403659:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.403666:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda42b1f/0xb28d70e125752400 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530623.403685:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.403686:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.403688:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530623.403694:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22766:x1875409555972096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89452us (90448us total) trans 0 rc 0/0 00010000:00010000:3.0:1788530623.403705:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530623.403708:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530623.403717:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530623.403726:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22766:1875409555972096:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788530623.403748:0:22766:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00010000:00010000:1.0:1788530623.403803:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530623.403804:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22766:1875409555973120:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788530623.403804:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530623.403806:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530623.403839:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.403869:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530623.403877:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973120 00000100:00100000:1.0:1788530623.403885:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973120 00000100:00100000:1.0:1788530623.403967:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530623.403976:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22766:x1875409555973120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788530623.404011:0:24248:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788530623.414540:0:24242:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788530623.414739:0:24242:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788530623.415253:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22766:x1875409555973120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11273us (11408us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788530623.415265:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530623.415734:0:22766:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788530623.415745:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22766:1875409555973120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788530623.415762:0:22766:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788530623.425643:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530623.555510:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530623.555540:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555973248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530623.555630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530623.555996:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973248 00000100:00100000:2.0:1788530623.556006:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973248 00000100:00100000:2.0:1788530623.556062:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530623.556072:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555973248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530623.556095:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530623.556146:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555973248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530623.556153:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530623.556210:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555973248:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788530624.448875:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530624.577026:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555973376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530624.577105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530624.577255:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973376 00000100:00100000:3.0:1788530624.577264:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973376 00000100:00100000:3.0:1788530624.577330:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530624.577341:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555973376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530624.577375:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530624.577430:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555973376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530624.577456:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530624.577608:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555973376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530624.579655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555973504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530624.579733:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530624.581126:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973504 00000100:00100000:0.0:1788530624.581138:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973504 00000100:00100000:0.0:1788530624.581201:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530624.581212:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555973504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530624.581247:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788530624.581534:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555973504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 323us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530624.581543:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530624.581741:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555973504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788530625.472995:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530625.602504:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788530626.178039:0:25060:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788530626.178044:0:25060:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788530626.178046:0:25060:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788530626.178164:0:25060:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f345a9800 00000020:01000004:0.0:1788530626.178179:0:25060:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788530626.178193:0:25060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788530626.178207:0:25060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a9e0377b310) 00000020:00000080:0.0:1788530626.178225:0:25060:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788530626.218220:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788530626.219190:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788530626.219511:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788530626.220045:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788530626.220212:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788530626.220517:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788530626.220944:0:25060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788530626.224551:0:25060:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788530626.224985:0:25060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788530626.225005:0:25060:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788530626.225020:0:25060:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e12575240e 00000020:01000004:3.0:1788530626.225027:0:25060:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788530626.225054:0:25060:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788530626.225057:0:25060:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788530626.225063:0:25060:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788530626.225117:0:25060:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788530626.225122:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788530626.225123:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788530626.225125:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530626.225126:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530626.225127:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530626.225129:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530626.225130:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530626.225132:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530626.225133:0:25060:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530626.225136:0:25060:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788530626.225138:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530626.225139:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788530626.225140:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530626.225144:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530626.225145:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530626.225146:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530626.225147:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530626.225148:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530626.225149:0:25060:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530626.225177:0:25060:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788530626.225197:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973632:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530626.225264:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.225366:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.226024:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973632 00000100:00100000:2.0:1788530626.226032:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973632 00000100:00100000:2.0:1788530626.226108:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788530626.226119:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:25060:x1875409555973632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788530626.226147:0:22733:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788530626.226150:0:22733:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788530626.226155:0:22733:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788530626.226472:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:25060:x1875409555973632:12345-0@lo:253:mount.lustre.0 Request processed in 354us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.226480:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788530626.226554:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973632:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530626.226579:0:25060:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788530626.226581:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530626.226583:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530626.226584:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530626.226586:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530626.226587:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530626.226588:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530626.226590:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530626.226591:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530626.226592:0:25060:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788530626.226610:0:25060:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f345a9800 from lustre-OST0001 10000000:01000000:0.0:1788530626.226649:0:25060:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788530626.226652:0:25060:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788530626.226663:0:25060:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f345a9800 10000000:01000000:0.0:1788530626.226680:0:25060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530626.226707:0:25060:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530626.232710:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530626.239186:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530626.239206:0:25060:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f345a9800 from 1 10000000:01000000:0.0:1788530626.239210:0:25060:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788530626.239257:0:25060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.239270:0:25060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.239281:0:25060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.239304:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530626.239387:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.239630:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.239822:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973760 00000100:00100000:1.0:1788530626.239830:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973760 00000100:00100000:1.0:1788530626.240036:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788530626.240047:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+24:25060:x1875409555973760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530626.240060:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530626.240073:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02d400/0xb28d70e12575241c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752415 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.240103:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02d400/0xb28d70e12575241c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752415 expref: 25 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.240116:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02d400/0xb28d70e12575241c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752415 expref: 25 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.240126:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02d400, rc 0) 00000100:00100000:1.0:1788530626.240211:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555973760:12345-0@lo:101:mount.lustre.0 Request processed in 166us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.240230:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788530626.240309:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.240325:0:25060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575241c expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.240334:0:25060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575241c expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.240478:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530626.240505:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.240527:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.240691:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555973888 00000100:00100000:2.0:1788530626.240696:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555973888 00000100:00100000:2.0:1788530626.240821:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530626.240830:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555973888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530626.240911:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555973888:12345-0@lo:501:mount.lustre.0 Request processed in 82us (404us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530626.240918:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788530626.241063:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555973888:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788530626.241077:0:25060:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530626.241107:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530626.241130:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.241145:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.241176:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974016 00000100:00100000:2.0:1788530626.241179:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974016 00000100:00100000:2.0:1788530626.241195:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788530626.241200:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555974016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530626.241248:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555974016:12345-0@lo:501:mount.lustre.0 Request processed in 47us (116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530626.241255:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788530626.241313:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974016:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788530626.241329:0:25060:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788530626.241351:0:25060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575241c expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.241361:0:25060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3800/0xb28d70e125752415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575241c expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530626.241380:0:25060:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f345a9800 10000000:01000000:0.0:1788530626.241385:0:25060:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788530626.241418:0:25060:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530626.241494:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530626.241500:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530626.241507:0:25060:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788530626.241511:0:25060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530626.241539:0:25060:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530626.241583:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530626.241588:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530626.241594:0:25060:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f345a9800 10000000:01000000:0.0:1788530626.241598:0:25060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788530626.241615:0:25060:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788530626.241618:0:25060:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788530626.241637:0:25060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.241650:0:25060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.241660:0:25060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.241684:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530626.241718:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.242020:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.242162:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974144 00000100:00100000:1.0:1788530626.242167:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974144 00000100:00100000:1.0:1788530626.242201:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788530626.242207:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:25060:x1875409555974144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530626.242217:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530626.242228:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02d600/0xb28d70e12575242a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752423 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.242247:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02d600/0xb28d70e12575242a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752423 expref: 26 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.242257:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02d600/0xb28d70e12575242a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752423 expref: 26 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.242266:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02d600, rc 0) 00000100:00100000:1.0:1788530626.242303:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974144:12345-0@lo:101:mount.lustre.0 Request processed in 96us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.242310:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788530626.242491:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.242504:0:25060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575242a expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.242513:0:25060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575242a expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530626.243621:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000040:00080000:0.0:1788530626.244268:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530626.247090:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1788530626.247145:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1788530626.247159:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1788530626.247173:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1788530626.247186:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1788530626.247199:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:1.0:1788530626.247214:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:1.0:1788530626.247247:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:1.0:1788530626.247266:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:1.0:1788530626.247292:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:1.0:1788530626.247304:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 10 count 11 00000100:00100000:1.0:1788530626.247543:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530626.247828:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.247986:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.248078:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974272 00000100:00100000:2.0:1788530626.248086:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974272 00000100:00100000:2.0:1788530626.248166:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530626.248176:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530626.248326:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974272:12345-0@lo:501:mount.lustre.0 Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.248333:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788530626.248420:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530626.248452:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530626.248489:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.248701:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.249024:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974400 00000100:00100000:1.0:1788530626.249030:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974400 00000100:00100000:1.0:1788530626.249057:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788530626.249064:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530626.249848:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974400:12345-0@lo:503:mount.lustre.0 Request processed in 781us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.249863:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530626.250082:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530626.250610:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530626.250708:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530626.250823:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530626.250921:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.251105:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974528 00000100:00100000:1.0:1788530626.251111:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974528 00000100:00100000:1.0:1788530626.251149:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788530626.251156:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530626.251596:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974528:12345-0@lo:502:mount.lustre.0 Request processed in 438us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.251604:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530626.251709:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530626.251932:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788530626.251974:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:3.0:1788530626.251987:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:3.0:1788530626.251999:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:3.0:1788530626.252010:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:3.0:1788530626.252021:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:3.0:1788530626.252032:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:3.0:1788530626.252044:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:3.0:1788530626.252055:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:3.0:1788530626.252083:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530626.252121:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.252152:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3afbf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.252355:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974656 00000100:00100000:1.0:1788530626.252360:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974656 00000100:00100000:1.0:1788530626.252496:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788530626.252504:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530626.252610:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974656:12345-0@lo:502:mount.lustre.0 Request processed in 107us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.252617:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788530626.252807:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530626.252914:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:3.0:1788530626.252983:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788530626.254109:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788530626.254118:0:25064:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788530626.254124:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.254126:0:25064:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788530626.254134:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530626.254147:0:25064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a9f3d210000) 00000020:00000080:3.0:1788530626.254172:0:25064:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788530626.254179:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788530626.254252:0:25064:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f345a9800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788530626.254260:0:25064:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788530626.254273:0:25064:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e125752438 00010000:00010000:3.0:1788530626.259026:0:25064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788530626.259593:0:25064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788530626.261865:0:25064:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788530626.263386:0:25064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788530626.263404:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.263410:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.263412:0:25064:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788530626.263416:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.263420:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.263421:0:25064:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788530626.263424:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788530626.263426:0:25064:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788530626.263428:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.263431:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.263432:0:25064:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788530626.263434:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.263436:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.263438:0:25064:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788530626.263441:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788530626.263463:0:25064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.263465:0:25064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.263475:0:25064:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788530626.263479:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:0.0:1788530626.263731:0:25060:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788530626.263744:0:25060:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788530626.263764:0:25060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575242a expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.263777:0:25060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2400/0xb28d70e125752423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575242a expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530626.263785:0:25060:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f345a9800 from 1 10000000:01000000:0.0:1788530626.263796:0:25060:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530626.263837:0:25060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.263846:0:25060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.263865:0:25060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.263891:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530626.263970:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.264008:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.264239:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974784 00000100:00100000:1.0:1788530626.264247:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974784 00000100:00100000:1.0:1788530626.264304:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788530626.264313:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:25060:x1875409555974784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530626.264326:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530626.264337:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575243f expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.264360:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575243f expref: 27 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.264372:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575243f expref: 27 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.264381:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02c800, rc 0) 00000100:00100000:1.0:1788530626.264433:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:25060:x1875409555974784:12345-0@lo:101:mount.lustre.0 Request processed in 121us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.264440:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788530626.264592:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.264607:0:25060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.264617:0:25060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.265162:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974912:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788530626.265204:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.265229:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530626.265440:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555974912 00000100:00100000:3.0:1788530626.265445:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555974912 00000100:00100000:3.0:1788530626.265483:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530626.265490:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:25060:x1875409555974912:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788530626.265505:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788530626.265533:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530626.265537:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530626.265540:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788530626.265543:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 13 00000100:00100000:3.0:1788530626.265654:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:25060:x1875409555974912:12345-0@lo:256:mount.lustre.0 Request processed in 164us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530626.265661:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530626.265711:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555974912:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788530626.266631:0:25060:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530626.266646:0:25060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.266658:0:25060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530626.266665:0:25060:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f345a9800 from 1 10000000:01000000:3.0:1788530626.266677:0:25060:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530626.266705:0:25060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.266713:0:25060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.267017:0:25060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.267037:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530626.267083:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.267121:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.267201:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975040 00000100:00100000:0.0:1788530626.267207:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975040 00000100:00100000:0.0:1788530626.267251:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788530626.267260:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:25060:x1875409555975040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.267271:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530626.267289:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575244d expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.267311:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.267322:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.267332:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3c00, rc 0) 00000100:00100000:0.0:1788530626.267378:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975040:12345-0@lo:101:mount.lustre.0 Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.267385:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530626.267593:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530626.267608:0:25060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.267617:0:25060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530626.268807:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000040:00080000:3.0:1788530626.269170:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530626.269327:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788530626.269349:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788530626.269361:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788530626.269714:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788530626.269798:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788530626.269810:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788530626.269821:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788530626.269832:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788530626.269843:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788530626.270812:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:3.0:1788530626.270844:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:3.0:1788530626.270998:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:3.0:1788530626.271006:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 12 count 13 00000100:00100000:3.0:1788530626.271107:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530626.271165:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.271203:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.271346:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975168 00000100:00100000:0.0:1788530626.271355:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975168 00000100:00100000:0.0:1788530626.271415:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788530626.271424:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530626.271535:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975168:12345-0@lo:501:mount.lustre.0 Request processed in 111us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.271543:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530626.272510:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530626.272552:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530626.272619:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.272647:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.272765:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975296 00000100:00100000:0.0:1788530626.272771:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975296 00000100:00100000:0.0:1788530626.272806:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788530626.272814:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530626.273073:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975296:12345-0@lo:503:mount.lustre.0 Request processed in 259us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.273081:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788530626.273158:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788530626.273685:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530626.274108:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530626.274155:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.274187:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.274331:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975424 00000100:00100000:0.0:1788530626.274342:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975424 00000100:00100000:0.0:1788530626.274381:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788530626.274389:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530626.274595:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975424:12345-0@lo:502:mount.lustre.0 Request processed in 206us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.274602:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788530626.275037:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530626.275204:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:3.0:1788530626.275229:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:3.0:1788530626.275241:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:3.0:1788530626.275253:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:3.0:1788530626.275277:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:3.0:1788530626.275290:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:3.0:1788530626.275301:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:3.0:1788530626.275314:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:3.0:1788530626.275327:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:3.0:1788530626.275338:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:3.0:1788530626.275349:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:3.0:1788530626.276689:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530626.277063:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.277150:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530626.282820:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975552 00000100:00100000:1.0:1788530626.282834:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975552 00000100:00100000:1.0:1788530626.283310:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788530626.283322:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530626.283513:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975552:12345-0@lo:502:mount.lustre.0 Request processed in 194us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.283522:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788530626.284203:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530626.284296:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:0.0:1788530626.284309:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788530626.285089:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.285100:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285102:0:25068:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788530626.285109:0:25068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f345a9800 00000020:00000080:3.0:1788530626.285112:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530626.285121:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.285124:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285125:0:25068:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788530626.285128:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.285130:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285131:0:25068:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788530626.285135:0:25068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f345a9800 00000020:00000080:3.0:1788530626.285137:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530626.285194:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.285197:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285198:0:25068:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788530626.285200:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.285203:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285204:0:25068:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530626.285208:0:25068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f345a9800 00000020:00000080:3.0:1788530626.285210:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530626.285225:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.285227:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285229:0:25068:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530626.285231:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530626.285233:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285235:0:25068:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788530626.285238:0:25068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f345a9800 00000020:00000080:3.0:1788530626.285240:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530626.285256:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530626.285259:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530626.285260:0:25068:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788530626.285263:0:25068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000020:01000000:0.0:1788530626.294821:0:25060:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788530626.294844:0:25060:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530626.294880:0:25060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.294892:0:25060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530626.295058:0:25060:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788530626.295062:0:25060:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f345a9800 10000000:01000000:0.0:1788530626.295065:0:25060:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f345a9800 10000000:01000000:0.0:1788530626.295070:0:25060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530626.295087:0:25060:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530626.295166:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530626.295173:0:25060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530626.295185:0:25060:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f345a9800 from 1 10000000:01000000:0.0:1788530626.295188:0:25060:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788530626.295221:0:25060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295241:0:25060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295253:0:25060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.295275:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530626.295335:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.295379:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975680 00000100:00100000:0.0:1788530626.295385:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975680 00000100:00100000:0.0:1788530626.295424:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788530626.295433:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:25060:x1875409555975680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.295445:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530626.295458:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a2c00/0xb28d70e125752462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575245b expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295480:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a2c00/0xb28d70e125752462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575245b expref: 29 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295491:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a2c00/0xb28d70e125752462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575245b expref: 29 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295500:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2c00, rc 0) 00000100:00100000:0.0:1788530626.295531:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555975680:12345-0@lo:101:mount.lustre.0 Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.295537:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788530626.295595:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.295621:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530626.295635:0:25060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752462 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.295645:0:25060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752462 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530626.300031:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 52 count 51 00000040:00080000:0.0:1788530626.300330:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530626.300538:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1788530626.303104:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:0.0:1788530626.303162:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:0.0:1788530626.303176:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:0.0:1788530626.303187:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:0.0:1788530626.303199:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:0.0:1788530626.303212:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:0.0:1788530626.303223:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:0.0:1788530626.303234:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:0.0:1788530626.303246:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:0.0:1788530626.303257:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:0.0:1788530626.303269:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:0.0:1788530626.303281:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:0.0:1788530626.303292:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:0.0:1788530626.303304:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:0.0:1788530626.303315:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:0.0:1788530626.303326:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:0.0:1788530626.303338:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:0.0:1788530626.303361:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:0.0:1788530626.303373:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:0.0:1788530626.303387:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:0.0:1788530626.303403:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:0.0:1788530626.303429:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:0.0:1788530626.303443:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:0.0:1788530626.303455:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 160 off12472 00000040:00080000:0.0:1788530626.303467:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12696 00000040:00080000:0.0:1788530626.303479:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12920 00000040:00080000:0.0:1788530626.303492:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off13000 00000040:00080000:0.0:1788530626.303503:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13224 00000040:00080000:0.0:1788530626.303515:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13448 00000040:00080000:0.0:1788530626.303529:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13536 00000040:00080000:0.0:1788530626.303542:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13664 00000040:00080000:0.0:1788530626.303554:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13808 00000040:00080000:0.0:1788530626.303610:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13936 00000040:00080000:0.0:1788530626.303639:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14160 00000040:00080000:0.0:1788530626.303655:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14384 00000040:00080000:0.0:1788530626.306010:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14464 00000040:00080000:0.0:1788530626.306091:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14688 00000040:00080000:0.0:1788530626.306104:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14912 00000040:00080000:0.0:1788530626.306116:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 88 off15000 00000040:00080000:0.0:1788530626.306127:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 128 off15128 00000040:00080000:0.0:1788530626.306139:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 144 off15272 00000040:00080000:0.0:1788530626.306150:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 128 off15400 00000040:00080000:0.0:1788530626.306162:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 224 off15624 00000040:00080000:0.0:1788530626.306173:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off15848 00000040:00080000:0.0:1788530626.306185:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].46, 80 off15928 00000040:00080000:0.0:1788530626.306196:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].47, 224 off16152 00000040:00080000:0.0:1788530626.306208:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].48, 232 off16384 00000040:00080000:0.0:1788530626.306366:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].49, 224 off16608 00000040:00080000:0.0:1788530626.306395:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].50, 120 off16728 00000040:00080000:0.0:1788530626.306411:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].51, 224 off16952 00000040:00080000:0.0:1788530626.306416:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 51 count 51 00000100:00100000:0.0:1788530626.306528:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530626.306622:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.306679:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.308899:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975808 00000100:00100000:2.0:1788530626.308918:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975808 00000100:00100000:2.0:1788530626.308981:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788530626.308991:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555975808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530626.309160:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555975808:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.309168:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788530626.309478:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530626.309533:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530626.309624:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.309656:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.310187:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555975936 00000100:00100000:2.0:1788530626.310194:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555975936 00000100:00100000:2.0:1788530626.310236:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530626.310243:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555975936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530626.310341:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555975936:12345-0@lo:503:mount.lustre.0 Request processed in 98us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.310349:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788530626.311023:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555975936:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788530626.311432:0:25060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530626.311516:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530626.311600:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.311631:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976064 00000100:00100000:0.0:1788530626.311636:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976064 00000100:00100000:0.0:1788530626.311679:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788530626.311687:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530626.314063:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976064:12345-0@lo:502:mount.lustre.0 Request processed in 2369us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.314076:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788530626.314144:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.314166:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530626.314392:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:0.0:1788530626.314424:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:0.0:1788530626.314439:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:0.0:1788530626.314455:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:0.0:1788530626.314469:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:0.0:1788530626.314483:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:0.0:1788530626.314498:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:0.0:1788530626.314511:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:0.0:1788530626.314533:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:0.0:1788530626.314544:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:0.0:1788530626.314555:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:0.0:1788530626.314591:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:0.0:1788530626.314616:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:0.0:1788530626.314629:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:0.0:1788530626.314640:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:0.0:1788530626.314651:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:0.0:1788530626.314663:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:0.0:1788530626.314689:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:0.0:1788530626.314704:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:0.0:1788530626.314716:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:0.0:1788530626.314743:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:0.0:1788530626.314755:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:0.0:1788530626.314768:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:0.0:1788530626.314779:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:0.0:1788530626.314792:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 160 off12472 00000040:00080000:0.0:1788530626.314803:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12696 00000040:00080000:0.0:1788530626.314819:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12920 00000040:00080000:0.0:1788530626.314831:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off13000 00000040:00080000:0.0:1788530626.314867:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13224 00000040:00080000:0.0:1788530626.314884:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13448 00000040:00080000:0.0:1788530626.314896:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13536 00000040:00080000:0.0:1788530626.314909:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13664 00000040:00080000:0.0:1788530626.314922:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13808 00000040:00080000:0.0:1788530626.317525:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13936 00000040:00080000:0.0:1788530626.317620:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14160 00000040:00080000:0.0:1788530626.317634:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14384 00000040:00080000:0.0:1788530626.317645:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14464 00000040:00080000:0.0:1788530626.317657:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14688 00000040:00080000:0.0:1788530626.317680:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14912 00000040:00080000:0.0:1788530626.317694:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 88 off15000 00000040:00080000:0.0:1788530626.317705:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 128 off15128 00000040:00080000:0.0:1788530626.318493:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 144 off15272 00000040:00080000:0.0:1788530626.318522:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 128 off15400 00000040:00080000:0.0:1788530626.318538:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 224 off15624 00000040:00080000:0.0:1788530626.318600:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off15848 00000040:00080000:0.0:1788530626.318616:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].46, 80 off15928 00000040:00080000:0.0:1788530626.318630:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].47, 224 off16152 00000040:00080000:0.0:1788530626.318643:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].48, 232 off16384 00000100:00100000:0.0:1788530626.318716:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530626.320252:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.320302:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530626.320453:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976192 00000100:00100000:3.0:1788530626.320461:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976192 00000100:00100000:3.0:1788530626.320518:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788530626.320528:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530626.320688:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976192:12345-0@lo:502:mount.lustre.0 Request processed in 161us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530626.320696:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530626.321044:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530626.321265:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].49, 224 off16608 00000040:00080000:1.0:1788530626.321290:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].50, 120 off16728 00000100:00100000:1.0:1788530626.321320:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530626.321364:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.321432:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530626.329202:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976320 00000100:00100000:0.0:1788530626.329217:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976320 00000100:00100000:0.0:1788530626.329272:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788530626.329281:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530626.329452:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555976320:12345-0@lo:502:mount.lustre.0 Request processed in 172us (8087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.329461:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788530626.331907:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555976320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530626.332128:0:25060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].51, 224 off16952 00000040:00080000:0.0:1788530626.332141:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788530626.341358:0:25073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788530626.341377:0:25073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a9f2c14b310) 00000020:00000080:1.0:1788530626.341404:0:25073:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788530626.341495:0:25073:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f345a9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788530626.341500:0:25073:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f345a9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788530626.341503:0:25073:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f345a9800 3 00010000:00080000:1.0:1788530626.341535:0:25073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3459b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530626.345421:0:25073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788530626.345696:0:25073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788530626.347162:0:25073:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788530626.347183:0:25073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb28d70e125752470 00000100:00080000:1.0:1788530626.347196:0:25073:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530626.347202:0:25073:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9f3459b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530626.347240:0:25073:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f33afdc00 x1875409555976448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530626.347274:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555976448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530626.347352:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.347417:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976448 00000100:00100000:1.0:1788530626.347424:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976448 00000100:00100000:1.0:1788530626.347457:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530626.347464:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555976448:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788530626.347487:0:22743:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 834 last 0 00000020:00000080:1.0:1788530626.347514:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb28d70e125752477 00000004:00100000:1.0:1788530626.347528:0:22743:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788530626.347574:0:22743:0:(import.c:65:import_set_state_nolock()) ffff9a9f34599800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530626.347631:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875409555976448:12345-0@lo:38:llog_process_th.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.347639:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788530626.347756:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f33afdc00 x1875409555976448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.347767:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530626.347775:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788530626.347780:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530626.347784:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530626.347787:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3459b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530626.347792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555976448:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788530626.347808:0:25073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788530626.347874:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530626.347878:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530626.347880:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530626.347885:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 831 00000100:00080000:1.0:1788530626.347888:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788530626.347892:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530626.347903:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f33afd880 x1875409555976832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530626.348011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555976576:0@lo:400:kworker.0 00000100:00100000:0.0:1788530626.348044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.348066:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530626.348071:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555976704:0@lo:400:kworker.0 00000100:00100000:0.0:1788530626.348096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.348119:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976576 00000100:00100000:0.0:1788530626.348122:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976576 00000100:00100000:0.0:1788530626.348148:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530626.348162:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555976576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530626.348196:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555976576:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.348203:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530626.348231:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555976576:0@lo:400:kworker.0 00000100:00080000:1.0:1788530626.348402:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530626.348407:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530626.348409:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530626.348412:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 831 00000100:00080000:1.0:1788530626.348415:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788530626.348425:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530626.348439:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f33afd500 x1875409555977344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530626.348481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555977472:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.348508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.348530:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530626.348536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555977216:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.348576:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.348603:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555976960:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.348626:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.348643:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555977600:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.348661:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.348691:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530626.348696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555977088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.348836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.348925:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977088 00000100:00100000:0.0:1788530626.348929:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977088 00000100:00100000:0.0:1788530626.348967:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530626.348974:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555977088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530626.349009:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555977088:12345-0@lo:400:kworker.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.349016:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530626.349130:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555977088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349137:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555977728:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.349191:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976704 00000100:00100000:1.0:1788530626.349194:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976704 00000100:00100000:1.0:1788530626.349227:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977216 00000100:00100000:1.0:1788530626.349230:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977216 00000100:00100000:1.0:1788530626.349265:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530626.349271:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349315:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555976704:12345-0@lo:400:kworker.0 Request processed in 45us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.349328:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530626.349341:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788530626.349347:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555977216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349379:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555977216:12345-0@lo:400:kworker.0 Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.349385:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788530626.349402:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977472 00000100:00100000:1.0:1788530626.349406:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977472 00000100:00100000:1.0:1788530626.349422:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976960 00000100:00100000:1.0:1788530626.349425:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976960 00000100:00100000:1.0:1788530626.349433:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977600 00000100:00100000:1.0:1788530626.349435:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977600 00000100:00100000:1.0:1788530626.349446:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977728 00000100:00100000:1.0:1788530626.349449:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977728 00000100:00100000:1.0:1788530626.349482:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530626.349488:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555977472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349519:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555977472:12345-0@lo:400:kworker.0 Request processed in 30us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.349525:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530626.349536:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530626.349541:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555976960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349596:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555976960:12345-0@lo:400:kworker.0 Request processed in 55us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.349602:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530626.349613:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530626.349619:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555977600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.349656:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555977600:12345-0@lo:400:kworker.0 Request processed in 38us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.349662:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530626.349708:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530626.349715:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555977728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530626.350190:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555976704:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.350266:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555977728:12345-0@lo:400:kworker.0 Request processed in 551us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530626.350272:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788530626.350295:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530626.350299:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530626.350302:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530626.350326:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555977216:0@lo:400:kworker.0 00010000:00080000:1.0:1788530626.350337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f33aff800 x1875409555977472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.350347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555977472:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.350366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555976832:0@lo:8:kworker.0 00000100:00100000:1.0:1788530626.350392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.350453:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555977344:0@lo:8:kworker.0 00000100:00100000:1.0:1788530626.350486:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.351814:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555976832 00000100:00100000:0.0:1788530626.351825:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555976832 00000100:00100000:0.0:1788530626.351863:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977344 00000100:00100000:0.0:1788530626.351866:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977344 00000100:00100000:0.0:1788530626.351882:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530626.351889:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555976832:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788530626.351963:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555976832:12345-0@lo:8:kworker.0 Request processed in 73us (1570us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788530626.351970:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530626.351984:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530626.351988:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555977344:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788530626.352012:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555977344:12345-0@lo:8:kworker.0 Request processed in 23us (1526us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788530626.352029:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788530626.352448:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0375e300 x1875409555977728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.352462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555977728:0@lo:400:kworker.0 00010000:00080000:1.0:1788530626.352476:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f33aff480 x1875409555976960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.352498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555976960:0@lo:400:kworker.0 00010000:00080000:1.0:1788530626.352513:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f33afdc00 x1875409555977600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.352520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555977600:0@lo:400:kworker.0 00000100:00100000:1.0:1788530626.352588:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530626.352595:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530626.352599:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788530626.352602:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555976832:0@lo:8:kworker.0 00000100:00100000:1.0:1788530626.352611:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530626.352614:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530626.352617:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788530626.352620:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555977344:0@lo:8:kworker.0 00000020:01000004:2.0:1788530626.353148:0:25073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788530626.353175:0:25073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a9e0322b310) 00000020:00000080:2.0:1788530626.353199:0:25073:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788530626.353292:0:25073:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f345a9800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788530626.353300:0:25073:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f345a9800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788530626.353302:0:25073:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f345a9800 3 00010000:00080000:2.0:1788530626.353330:0:25073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e03717000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530626.356611:0:25073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788530626.356816:0:25073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788530626.356864:0:25073:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788530626.356877:0:25073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb28d70e125752485 00000100:00080000:3.0:1788530626.356888:0:25073:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530626.356894:0:25073:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a9e03717000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530626.356932:0:25073:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e037e4e00 x1875409555977856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530626.356961:0:25073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788530626.357019:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555977856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530626.357093:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.359651:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977856 00000100:00100000:3.0:1788530626.359677:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977856 00000100:00100000:3.0:1788530626.359734:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530626.359745:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555977856:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788530626.359780:0:22742:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 834 last 0 00000020:00000080:3.0:1788530626.360058:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb28d70e12575248c 00000004:00100000:3.0:1788530626.360078:0:22742:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788530626.360115:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9a9e03f0c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530626.360217:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875409555977856:12345-0@lo:38:llog_process_th.0 Request processed in 473us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530626.360226:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788530626.360720:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00010000:00080000:1.0:1788530626.360908:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e4e00 x1875409555977856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530626.360920:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530626.360929:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000020:01000000:2.0:1788530626.361063:0:25060:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788530626.361077:0:25060:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788530626.361099:0:25060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752462 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.361111:0:25060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2000/0xb28d70e12575245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752462 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788530626.361164:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788530626.361166:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788530626.361167:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530626.361169:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530626.361170:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530626.361172:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530626.361173:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530626.361175:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530626.361177:0:25060:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788530626.361180:0:25060:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788530626.361183:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788530626.361184:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788530626.361185:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530626.361186:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530626.361187:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530626.361188:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530626.361189:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530626.361190:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530626.361191:0:25060:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788530626.361213:0:25060:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788530626.361231:0:25060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555977984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788530626.361281:0:25060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530626.361323:0:25060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7480 going to sleep for 11 seconds 00000100:00080000:1.0:1788530626.361426:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530626.361432:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788530626.361435:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e03717000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530626.361441:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555977856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530626.361609:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555977984 00000100:00100000:2.0:1788530626.361621:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555977984 00000100:00100000:2.0:1788530626.361681:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788530626.361690:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555977984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788530626.361714:0:22736:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788530626.361736:0:22736:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788530626.367269:0:22736:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788530626.367292:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788530626.367410:0:22757:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788530626.367416:0:22757:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788530626.367551:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530626.367585:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:25060:x1875409555977984:12345-0@lo:253:mount.lustre.0 Request processed in 5892us (6299us total) trans 0 rc 0/0 00010000:00010000:3.0:1788530626.367586:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522ef expref: 29 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367594:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522fd expref: 29 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530626.367595:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:3.0:1788530626.367601:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575230b expref: 29 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367607:0:22757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575243f expref: 29 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367614:0:22757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367652:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367675:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 28 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.367690:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978112:0@lo:104: 00000100:00100000:0.0:1788530626.367711:0:25060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fdaa18b0-da07-49cb-a5c5-729ae13b1075:25060:1875409555977984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530626.367726:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788530626.367735:0:25060:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788530626.367738:0:25060:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530626.367740:0:25060:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530626.367741:0:25060:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530626.367742:0:25060:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530626.367744:0:25060:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530626.367745:0:25060:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530626.367746:0:25060:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530626.367748:0:25060:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530626.367750:0:25060:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788530626.367764:0:25060:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788530626.367771:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367793:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 28 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.367802:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978240:0@lo:104: 00000100:00100000:3.0:1788530626.367823:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530626.367846:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.367853:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 28 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.367862:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978368:0@lo:104: 00000100:00100000:3.0:1788530626.367882:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530626.367891:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978112 00010000:00010000:3.0:1788530626.367898:0:22757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530626.367898:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978112 00010000:00010000:3.0:1788530626.367906:0:22757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 28 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.367913:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978496:0@lo:104: 00000100:00100000:2.0:1788530626.367923:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978240 00000100:00100000:2.0:1788530626.367926:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978240 00000100:00100000:3.0:1788530626.367932:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.367942:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0b243e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530626.367949:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978368 00000100:00100000:2.0:1788530626.367951:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978368 00000100:00100000:3.0:1788530626.367956:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978496 00000100:00100000:3.0:1788530626.367959:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978496 00000100:00100000:2.0:1788530626.367964:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530626.367972:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22757:x1875409555978112:12345-0@lo:104: 00010000:00010000:2.0:1788530626.367985:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368035:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530626.368040:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:22757:x1875409555978112:12345-0@lo:104: Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.368047:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530626.368059:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530626.368065:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22757:x1875409555978240:12345-0@lo:104: 00010000:00010000:2.0:1788530626.368073:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368113:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530626.368118:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:22757:x1875409555978240:12345-0@lo:104: Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.368124:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530626.368135:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530626.368140:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555978368:12345-0@lo:104: 00010000:00010000:2.0:1788530626.368148:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368171:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788530626.368176:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:22757:x1875409555978368:12345-0@lo:104: Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.368182:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530626.368191:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530626.368196:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555978496:12345-0@lo:104: 00010000:00010000:2.0:1788530626.368203:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368222:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788530626.368226:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:22757:x1875409555978496:12345-0@lo:104: Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.368232:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788530626.368246:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788530626.368252:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368269:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530626.368274:0:24909:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368283:0:24909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530626.368291:0:24909:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530626.368297:0:24909:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530626.368319:0:24909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368326:0:24909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530626.368354:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368361:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a3000/0xb28d70e12575243f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752446 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368373:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788530626.368376:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368381:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2e00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530626.368384:0:24909:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368402:0:24909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530626.368409:0:24909:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530626.368414:0:24909:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530626.368426:0:24909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368432:0:24909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530626.368437:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368444:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e010a2e00/0xb28d70e12575230b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752312 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368454:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530626.368456:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368462:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530626.368465:0:24909:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368471:0:24909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530626.368477:0:24909:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530626.368488:0:24909:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530626.368502:0:24909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368507:0:24909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530626.368523:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368529:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e1257522fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752304 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368538:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530626.368541:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368547:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530626.368549:0:24909:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368557:0:24909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530626.368584:0:24909:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530626.368590:0:24909:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530626.368603:0:24909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368609:0:24909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530626.368622:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368629:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257522ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522f6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.368642:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530626.368644:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530626.368645:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530626.368645:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530626.368651:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530626.368683:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978112:0@lo:104: 00000100:00100000:3.0:1788530626.368692:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978240:0@lo:104: 00000100:00100000:3.0:1788530626.368698:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978368:0@lo:104: 00000100:00100000:3.0:1788530626.368714:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22757:1875409555978496:0@lo:104: 00010000:00010000:3.0:1788530626.368736:0:22757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530626.368904:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555978624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530626.369130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530626.369162:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530626.369168:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555978752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530626.369187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530626.369593:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978624 00000100:00100000:3.0:1788530626.369600:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978624 00010000:00010000:3.0:1788530626.369623:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 29 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.369649:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978752 00000100:00100000:3.0:1788530626.369652:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978752 00010000:00010000:3.0:1788530626.369663:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 30 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.369700:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530626.369705:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530626.369708:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+30:3647:x1875409555978624:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530626.369712:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+30:3647:x1875409555978752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530626.369720:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530626.369725:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 30 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.369736:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 30 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.369753:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575243f expref: 30 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530626.369767:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530626.369799:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788530626.369804:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3647:x1875409555978624:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (674us total) trans 0 rc 0/0 00010000:00010000:0.0:1788530626.369805:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 29 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.369810:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788530626.369814:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 29 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.369824:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb200/0xb28d70e125752312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575230b expref: 29 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530626.369842:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530626.369933:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555978624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530626.369952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555978752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530626.370004:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:3647:x1875409555978752:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530626.370011:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530626.370149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555978880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530626.370178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530626.370424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530626.370431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555979008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530626.370453:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530626.371473:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555978880 00000100:00100000:2.0:1788530626.371482:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555978880 00010000:00010000:2.0:1788530626.371512:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 27 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530626.371541:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979008 00000100:00100000:3.0:1788530626.371546:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979008 00010000:00010000:3.0:1788530626.371581:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 28 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530626.371593:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530626.371607:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:3649:x1875409555978880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530626.371619:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530626.371625:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 28 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371637:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 28 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371651:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141200/0xb28d70e125752304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257522fd expref: 28 pid: 22733 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371664:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530626.371728:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:3649:x1875409555978880:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.371735:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530626.371759:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530626.371765:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:3649:x1875409555979008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530626.371772:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530626.371777:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 26 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371786:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 26 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371796:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eaa00/0xb28d70e1257522f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257522ef expref: 26 pid: 22736 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371808:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371817:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788530626.371832:0:22728:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017298453s 00010000:00010000:2.0:1788530626.371837:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.371845:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530626.372061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555978880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530626.372099:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.372108:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.372115:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530626.372126:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.372135:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.372156:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530626.372167:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530626.372194:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:3649:x1875409555979008:12345-0@lo:103:ldlm_bl.0 Request processed in 429us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530626.372200:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788530626.372241:0:22757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.372250:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530626.372257:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012ea000/0xb28d70e125752493 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530626.372281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555979008:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788530626.373159:0:25060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788530626.375629:0:25060:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788530626.375639:0:25060:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788530626.375691:0:25060:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788530626.375710:0:25060:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788530626.376706:0:25060:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530626.377095:0:25060:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530626.497821:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530627.362259:0:25128:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530627.362512:0:25128:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530627.521357:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788530627.521649:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530627.521654:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f345a9800 from 14 10000000:01000000:3.0:1788530627.521666:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530627.521711:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.521724:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.521736:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530627.521763:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530627.521829:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530627.521862:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06574e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530627.521955:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979136 00000100:00100000:2.0:1788530627.521964:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979136 00000100:00100000:2.0:1788530627.522026:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788530627.522037:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:22738:x1875409555979136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530627.522051:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530627.522065:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36be00/0xb28d70e1257524a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575249a expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.522088:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36be00/0xb28d70e1257524a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575249a expref: 26 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.522098:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36be00/0xb28d70e1257524a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575249a expref: 26 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.522107:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:2.0:1788530627.522158:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555979136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530627.522171:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788530627.522413:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530627.522429:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524a1 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.522438:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257524a1 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530627.522489:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530627.522521:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530627.522547:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03762a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530627.522814:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979264 00000100:00100000:2.0:1788530627.522820:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979264 00000100:00100000:2.0:1788530627.522862:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788530627.522870:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555979264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530627.522885:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530627.522901:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530627.522904:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788530627.523013:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555979264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530627.523021:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788530627.523135:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530627.523173:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530627.523181:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524a1 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.523189:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eaa00/0xb28d70e12575249a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524a1 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530627.523208:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530627.523210:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaea000 from 14 10000000:01000000:3.0:1788530627.523213:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530627.523233:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.523240:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.523249:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530627.523264:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530627.523290:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530627.523310:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f065746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530627.527822:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979392 00000100:00100000:2.0:1788530627.527840:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979392 00000100:00100000:2.0:1788530627.527911:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788530627.527930:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555979392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530627.527950:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530627.527971:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a800/0xb28d70e1257524af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257524a8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.528002:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a800/0xb28d70e1257524af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257524a8 expref: 27 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.528015:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a800/0xb28d70e1257524af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257524a8 expref: 27 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.528024:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a800, rc 0) 00000100:00100000:2.0:1788530627.528111:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555979392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530627.528128:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788530627.528155:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530627.528176:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524af expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530627.528187:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257524af expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530627.528255:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788530627.528294:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530627.528331:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f065746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530627.529253:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979520 00000100:00100000:2.0:1788530627.529260:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979520 00000100:00100000:2.0:1788530627.529299:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788530627.529306:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555979520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530627.529321:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530627.529337:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530627.529341:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788530627.529506:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555979520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530627.529514:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788530627.529550:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530627.529711:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530627.529720:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524af expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.529730:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257524a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524af expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530627.529743:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530627.529746:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03d6c000 from 14 10000000:01000000:2.0:1788530627.529748:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530627.529771:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.529779:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.529798:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530627.529814:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530627.530021:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530627.530141:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788530627.532767:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979648 00000100:00100000:0.0:1788530627.532782:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979648 00000100:00100000:0.0:1788530627.532830:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788530627.532840:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555979648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530627.535096:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530627.535124:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3200/0xb28d70e1257524bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257524b6 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.535175:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3200/0xb28d70e1257524bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257524b6 expref: 28 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.535187:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3200/0xb28d70e1257524bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257524b6 expref: 28 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.535195:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3200, rc 0) 00000100:00100000:0.0:1788530627.535290:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555979648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2450us (5268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530627.535297:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788530627.536863:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530627.536890:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524bd expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.536902:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257524bd expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530627.536991:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530627.537046:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530627.537080:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788530627.537707:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979776 00000100:00100000:0.0:1788530627.537716:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979776 00000100:00100000:0.0:1788530627.537763:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788530627.537771:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555979776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530627.537792:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530627.537808:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530627.537811:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788530627.537915:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555979776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530627.538050:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788530627.539146:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530627.539276:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530627.539295:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524bd expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.539316:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e1257524b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524bd expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530627.539339:0:22738:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530627.539342:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f3b266000 from 14 10000000:01000000:2.0:1788530627.539375:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530627.539464:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.539485:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.539495:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530627.539523:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530627.539650:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530627.539722:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788530627.539825:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555979904 00000100:00100000:0.0:1788530627.539831:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555979904 00000100:00100000:0.0:1788530627.539891:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788530627.539900:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555979904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530627.539912:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530627.540037:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3600/0xb28d70e1257524cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257524c4 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.540074:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3600/0xb28d70e1257524cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257524c4 expref: 29 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.540085:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3600/0xb28d70e1257524cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257524c4 expref: 29 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530627.540095:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3600, rc 0) 00000100:00100000:0.0:1788530627.540132:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555979904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530627.540139:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788530627.540240:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555979904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530627.540254:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524cb expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.540262:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257524cb expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530627.540306:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555980032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530627.540337:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530627.540352:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530627.540439:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980032 00000100:00100000:2.0:1788530627.540444:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980032 00000100:00100000:2.0:1788530627.540468:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788530627.540475:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555980032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530627.540487:0:22736:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530627.540505:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530627.540508:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788530627.540591:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555980032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530627.540598:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788530627.541170:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555980032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530627.541217:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530627.541224:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524cb expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530627.541232:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e1257524c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257524cb expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530628.545175:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530628.674336:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555980288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530628.674422:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530628.674468:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530628.674475:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555980160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530628.674499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530628.674539:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980288 00000100:00100000:1.0:1788530628.674546:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980288 00000100:00100000:1.0:1788530628.674606:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980160 00000100:00100000:1.0:1788530628.674620:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980160 00000100:00100000:2.0:1788530628.674867:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530628.674879:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555980288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530628.674908:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530628.674970:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555980288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530628.674977:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530628.675113:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530628.675120:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555980160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530628.675131:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530628.675158:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555980160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530628.675164:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788530628.675181:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530628.675217:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555980160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530628.675229:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555980288:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788530629.569117:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530629.706059:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555980416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530629.706130:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530629.706257:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530629.706265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555980544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530629.706292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530629.706326:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980416 00000100:00100000:2.0:1788530629.706332:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980416 00000100:00100000:2.0:1788530629.706368:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980544 00000100:00100000:2.0:1788530629.706370:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980544 00000100:00100000:2.0:1788530629.706386:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530629.706408:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555980416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530629.706442:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788530629.706485:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555980416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530629.706493:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530629.706509:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530629.706514:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555980544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530629.706529:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530629.706554:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555980544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530629.706583:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530629.706620:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555980544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530629.706644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555980416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788530630.596376:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530630.919344:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530631.624591:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530631.746360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530631.746367:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530631.746371:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530631.746384:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e024de800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530631.746410:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f32bd1180 x1875409555981056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530631.746447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530631.746450:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530631.746452:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530631.746456:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f3b05a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530631.746466:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03693100 x1875409555981568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530631.746708:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555980800:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.746782:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.746828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555981440:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.746852:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.746869:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555982080:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.746896:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.746921:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788530631.746927:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555980672:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.746954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.746974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555981312:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.746995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.747012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555981952:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.747032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.747062:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980800 00000100:00100000:0.0:1788530631.747077:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980800 00000100:00100000:0.0:1788530631.747112:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981312 00000100:00100000:0.0:1788530631.747115:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981312 00000100:00100000:0.0:1788530631.747197:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530631.747208:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555980800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.747265:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555980800:12345-0@lo:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.747272:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530631.747291:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530631.747297:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555981312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.747324:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555981312:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.747330:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530631.747347:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981440 00000100:00100000:0.0:1788530631.747350:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981440 00000100:00100000:0.0:1788530631.747385:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530631.747392:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555981440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.747423:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555981440:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.747429:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530631.747446:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980672 00000100:00100000:0.0:1788530631.747449:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980672 00000100:00100000:0.0:1788530631.747475:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788530631.747481:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3648:x1875409555980672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.747508:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3648:x1875409555980672:12345-0@lo:400:kworker.0 Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.747514:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788530631.747789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555980928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530631.747826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530631.747852:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555981696:0@lo:400:kworker.0 00000100:00100000:2.0:1788530631.747875:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530631.747891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555982208:0@lo:400:kworker.0 00000100:00100000:2.0:1788530631.747916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530631.747930:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530631.747937:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555981184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530631.747958:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530631.747970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555981824:0@lo:400:kworker.0 00000100:00100000:2.0:1788530631.747990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530631.748052:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982080 00000100:00100000:3.0:1788530631.748064:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982080 00000100:00100000:3.0:1788530631.748092:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981952 00000100:00100000:3.0:1788530631.748096:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981952 00000100:00100000:3.0:1788530631.748112:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981696 00000100:00100000:3.0:1788530631.748115:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981696 00000100:00100000:3.0:1788530631.748127:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982208 00000100:00100000:3.0:1788530631.748142:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982208 00000100:00100000:3.0:1788530631.748156:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981184 00000100:00100000:3.0:1788530631.748159:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981184 00000100:00100000:3.0:1788530631.748168:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981824 00000100:00100000:3.0:1788530631.748171:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981824 00000100:00100000:3.0:1788530631.748184:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530631.748191:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748229:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555982080:12345-0@lo:400:kworker.0 Request processed in 39us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748235:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530631.748249:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530631.748254:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748280:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555981952:12345-0@lo:400:kworker.0 Request processed in 26us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748286:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530631.748296:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530631.748302:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555981696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748338:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555981696:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748344:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530631.748355:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530631.748361:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555982208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748400:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555982208:12345-0@lo:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748406:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530631.748418:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530631.748423:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555981184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748447:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555981184:12345-0@lo:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748453:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530631.748463:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788530631.748469:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530631.748492:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555981824:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.748498:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530631.748972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3648:1875409555980672:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.748987:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555981312:0@lo:400:kworker.0 00010000:00080000:0.0:1788530631.749000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03692680 x1875409555981952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.749011:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555981952:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.749025:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555980800:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.749036:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555981440:0@lo:400:kworker.0 00010000:00080000:0.0:1788530631.749046:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03690700 x1875409555982080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.749054:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555982080:0@lo:400:kworker.0 00000100:00080000:0.0:1788530631.749090:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530631.749095:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530631.749098:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530631.749257:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd2680 x1875409555981184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530631.749268:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555981184:0@lo:400:kworker.0 00010000:00080000:3.0:1788530631.749284:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03691180 x1875409555981824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530631.749293:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555981824:0@lo:400:kworker.0 00010000:00080000:3.0:1788530631.749304:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03692300 x1875409555981696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530631.749312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555981696:0@lo:400:kworker.0 00010000:00080000:3.0:1788530631.749325:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03691c00 x1875409555982208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530631.749342:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555982208:0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.751262:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555981056:0@lo:8:kworker.0 00000100:00100000:0.0:1788530631.751338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.751386:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555981568:0@lo:8:kworker.0 00000100:00100000:0.0:1788530631.751409:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.751452:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555980928 00000100:00100000:0.0:1788530631.751459:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555980928 00000100:00100000:0.0:1788530631.751504:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981056 00000100:00100000:0.0:1788530631.751507:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981056 00000100:00100000:0.0:1788530631.751516:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555981568 00000100:00100000:0.0:1788530631.751518:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555981568 00000100:00100000:0.0:1788530631.751528:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530631.751672:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530631.751679:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555981056:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788530631.751714:0:24247:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 839 last 0 00000020:00000080:3.0:1788530631.751740:0:24247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257524d2 00002000:00100000:3.0:1788530631.751755:0:24247:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a9e03f0a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788530631.751759:0:24247:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788530631.751762:0:24247:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530631.751937:0:24247:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788530631.751958:0:24247:0:(import.c:65:import_set_state_nolock()) ffff9a9e03f08800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530631.752012:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555981056:12345-0@lo:8:kworker.0 Request processed in 332us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.752019:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530631.752037:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530631.752041:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555981568:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788530631.752056:0:24247:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 839 last 0 00000020:00000080:3.0:1788530631.752070:0:24247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257524d9 00002000:00100000:3.0:1788530631.752076:0:24247:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a9e03f0d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788530631.752080:0:24247:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788530631.752081:0:24247:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530631.752105:0:24247:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788530631.752117:0:24247:0:(import.c:65:import_set_state_nolock()) ffff9a9e03f0e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530631.752156:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555981568:12345-0@lo:8:kworker.0 Request processed in 113us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.752175:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530631.752677:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555980928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530631.752726:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555980928:12345-0@lo:400:kworker.0 Request processed in 1190us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.752732:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788530631.752751:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530631.752781:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd1180 x1875409555981056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530631.752797:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788530631.752804:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788530631.752808:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788530631.752811:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024de800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788530631.752823:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788530631.752828:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555981056:0@lo:8:kworker.0 00010000:00080000:0.0:1788530631.752839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03693100 x1875409555981568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530631.752848:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788530631.752852:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788530631.752855:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788530631.752857:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b05a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788530631.752886:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788530631.752890:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555981568:0@lo:8:kworker.0 00000004:00080000:0.0:1788530631.752944:0:22768:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788530631.752960:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22768:1875409555982464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788530631.752986:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.753005:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e037623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530631.753018:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555982336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530631.753050:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.753079:0:24247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982464 00000100:00100000:0.0:1788530631.753084:0:24247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982464 00000100:00100000:0.0:1788530631.753116:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530631.753124:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22768:x1875409555982464:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788530631.753368:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788530631.754340:0:23484:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788530631.754365:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982720:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788530631.754414:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530631.754439:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530631.754460:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982336 00000100:00100000:1.0:1788530631.754466:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982336 00000100:00100000:1.0:1788530631.754507:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530631.754515:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875409555982336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530631.754552:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000004:00080000:3.0:1788530631.755828:0:22767:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788530631.755934:0:22767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839658372656ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788530631.755943:0:22767:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788530631.756126:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555980928:0@lo:400:kworker.0 00000004:00080000:2.0:1788530631.756256:0:23483:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788530631.756304:0:23483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 839658743050ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788530631.756310:0:23483:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788530631.756823:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982720 00000100:00100000:2.0:1788530631.756831:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982720 00000100:00100000:2.0:1788530631.756886:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788530631.756896:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23484:x1875409555982720:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788530631.756950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530631.756964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555982592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530631.757024:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788530631.757080:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530631.757888:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875409555982336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3370us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530631.757899:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530631.757929:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982592 00000100:00100000:1.0:1788530631.757934:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982592 00000100:00100000:1.0:1788530631.757957:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530631.757965:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875409555982592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530631.757982:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530631.758029:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875409555982592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530631.758035:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788530631.758180:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f33aff100 x1875409555982592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.758199:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555982592:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788530631.758514:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd1180 x1875409555982336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530631.758528:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555982336:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788530631.759239:0:22721:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788530631.764530:0:24247:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788530631.764552:0:24247:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788530631.764557:0:24247:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:0.0:1788530631.769765:0:24899:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788530631.769777:0:24899:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788530631.769874:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23484:x1875409555982720:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12976us (15455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.769885:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788530631.769949:0:23484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f33afd180 x1875409555982720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530647 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.769965:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982720:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788530631.769980:0:23484:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788530631.770041:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982848:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788530631.770076:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.770099:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530631.770119:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982848 00000100:00100000:0.0:1788530631.770125:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982848 00000100:00100000:0.0:1788530631.770169:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530631.770179:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23484:x1875409555982848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788530631.770204:0:24248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788530631.770250:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23484:x1875409555982848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530631.770257:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788530631.770287:0:23484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd1180 x1875409555982848/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530647 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.770297:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982848:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788530631.770306:0:23484:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788530631.770353:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982976:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788530631.770498:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.770517:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530631.770536:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555982976 00000100:00100000:0.0:1788530631.770540:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555982976 00000100:00100000:0.0:1788530631.770592:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530631.770600:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23484:x1875409555982976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788530631.770636:0:24899:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788530631.775307:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.775320:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775338:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.775342:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.775349:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775365:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775377:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775385:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775412:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.775425:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.775432:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775440:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02ce00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.775445:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775455:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775471:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775479:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e1257524e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.775500:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.775502:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.775504:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.778889:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.778901:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.778918:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.778929:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.778936:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.778951:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.778961:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.778969:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788530631.778970:0:23473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:1.0:1788530631.778985:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.778995:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.779001:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.779009:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.779014:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.779023:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.779041:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.779057:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257524e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.779076:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.779078:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.779080:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.780091:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.780100:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.780113:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.780118:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.780123:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.780140:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.780149:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.780156:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.780183:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530631.781327:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.781342:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781357:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.781361:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.781366:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781377:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781387:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781395:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781413:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788530631.781424:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530631.781430:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781438:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.781443:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781452:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781474:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781482:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257524ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781500:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.781504:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781510:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02ca00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.781513:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781520:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.781530:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.782677:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.783745:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e1257524f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.783771:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.783772:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.783781:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530631.789524:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530631.789538:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.789580:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=839s v=(0 0) 00010000:00010000:3.0:1788530631.789586:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530631.789594:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.789612:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.789632:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.789640:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.789674:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.789716:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.789724:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.789732:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.789736:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.789746:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.789761:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.789768:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a07173d/0xb28d70e1257524fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.789789:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.789791:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.789793:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530631.791250:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530631.791260:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.791274:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=839s v=(0 0) 00010000:00010000:3.0:1788530631.791278:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530631.791285:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.791298:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.791307:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.791315:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.791358:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530631.791801:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530631.791816:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.791824:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530631.791828:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.791837:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.791855:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.791862:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c43577a3/0xb28d70e125752503 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530631.791881:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530631.791882:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530631.791884:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.793816:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.793828:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793843:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.793848:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.793854:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793874:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793884:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793892:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793912:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.793923:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.793929:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793936:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.793940:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793949:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793965:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793973:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575250a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.793997:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.793999:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.794001:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.794423:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.794429:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794438:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.794442:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.794446:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794456:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794464:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794471:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794484:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530631.794788:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.794793:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794812:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.794816:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.794820:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794830:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794838:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794845:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794865:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530631.794872:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794877:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530631.794886:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02da00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.794886:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.794890:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794895:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794897:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02ca00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.794900:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794903:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794907:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794917:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794924:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000204c8cc7/0xb28d70e125752511 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794926:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.794934:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e125752518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.794939:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.794940:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.794942:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.794945:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.794946:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.794948:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530631.796527:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530631.796537:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.796552:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=839s v=(0 0) 00010000:00010000:3.0:1788530631.796555:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530631.796591:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.796604:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.796613:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.796641:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.796657:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.797275:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.797283:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.797293:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.797298:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.797307:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.797323:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.797332:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdd0adfa/0xb28d70e12575251f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.797360:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.797362:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.797364:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.797732:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.797739:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.797749:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.797753:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.797758:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.797768:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.797785:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.797792:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.797848:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530631.798491:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530631.798498:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.798507:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.798510:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.798519:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.798534:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.798541:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.798579:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.798581:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.798583:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.798993:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.799000:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.799011:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.799015:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.799021:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.799032:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.799040:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.799047:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.799071:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.799144:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.799151:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.799159:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.799162:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.799171:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.799182:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.799188:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e12575252d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.799203:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.799211:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.799212:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.800490:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.800499:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.800523:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.800527:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.800533:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.800557:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.800599:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.800608:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.800638:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530631.800656:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530631.800668:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.800676:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.800680:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.800688:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.800703:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.800710:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e125752534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.800726:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.800729:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.800730:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.803939:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.803951:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.803968:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.803973:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.803980:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.803993:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.804014:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.804022:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.804044:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.805542:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.805555:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.805578:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02ca00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.805583:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.805593:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.805610:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.805627:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb6589a/0xb28d70e12575253b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.805654:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.805656:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.805658:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.806814:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.806826:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.806840:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.806845:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.806857:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.806870:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.806879:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807805:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807826:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.807838:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.807844:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807852:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.807857:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807868:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807898:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807916:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eda42b1f/0xb28d70e125752542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.807939:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.807942:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.807944:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.808975:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.808985:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.809701:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.809706:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.809714:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.809727:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.809738:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.809747:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.809770:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530631.809956:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530631.809963:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.809972:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.809976:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.810011:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.810027:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.810034:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125752549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.810054:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.810056:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.810058:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.810839:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.810853:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.810865:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.810869:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.810875:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.810891:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.810901:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.810908:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.810963:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788530631.811362:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.811368:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.811377:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.811380:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.811384:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.811408:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.811423:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.811431:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811746:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530631.811753:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811767:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.811771:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811780:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811796:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811816:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125752550 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811834:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530631.811837:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811844:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.811847:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811859:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811870:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.811878:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.811880:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.811881:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788530631.812164:0:25061:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788530631.812188:0:25061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788530631.812195:0:25061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788530631.812253:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530631.812259:0:24247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125752557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.812279:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530631.812664:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23484:x1875409555982976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42060us (42272us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788530631.812674:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530631.812724:0:23484:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788530631.812732:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23484:1875409555982976:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788530631.812748:0:23484:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788530631.812799:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23484:1875409555983104:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788530631.812836:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530631.813205:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17635600 going to sleep for 11 seconds 00002000:00010000:1.0:1788530631.813221:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.813229:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.813243:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.813248:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.813254:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.813267:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.813275:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.813282:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.813317:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.813366:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.813374:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813545:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.813550:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813574:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813591:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813599:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006781f398/0xb28d70e12575255e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813626:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.813628:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.813630:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.813757:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.813764:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813772:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.813775:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.813780:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813788:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813801:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813809:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813823:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.813832:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.813836:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813843:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.813847:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813854:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813866:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813874:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125752565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.813897:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.813905:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.813906:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.814655:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.814664:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.814674:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.814676:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.814681:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.814691:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.814699:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.814707:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.814720:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.814748:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.814753:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.814761:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c64800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.814765:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.814773:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.814785:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.814792:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ade3c7/0xb28d70e12575256c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.814806:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.814808:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.814809:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530631.815187:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530631.815193:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.815202:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=839s v=(0 0) 00010000:00010000:0.0:1788530631.815204:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530631.815209:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.815226:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.815236:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.815243:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.815257:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530631.816018:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.816025:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816035:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.816044:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.816049:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816058:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816066:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816073:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816088:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788530631.816364:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.816370:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816378:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.816381:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.816385:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816394:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816402:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816416:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816430:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788530631.816440:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530631.816444:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816452:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c65600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.816456:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816465:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816480:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816487:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e2f8589/0xb28d70e125752573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816504:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530631.816507:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816525:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02ce00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.816528:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.816594:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.816601:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.816608:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.816611:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816624:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.816628:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816636:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.816639:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816645:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf410672/0xb28d70e12575257a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.816647:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b756e5b/0xb28d70e125752581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816657:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.816659:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.816661:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.816665:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.816666:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.816668:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.816674:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.816930:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.816936:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816944:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.816948:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.816952:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816962:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816975:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816982:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.816994:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530631.817001:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.817004:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817010:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.817013:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817020:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817031:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817038:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c657d64/0xb28d70e125752588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817050:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.817058:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.817059:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.817315:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.817321:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817329:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.817332:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.817337:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817345:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817353:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817360:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.817372:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788530631.817553:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983104 00000100:00100000:3.0:1788530631.817581:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983104 00000100:00100000:3.0:1788530631.817643:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530631.817660:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23484:x1875409555983104:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788530631.817760:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23484:x1875409555983104:12345-0@lo:900:osp-pre-1-1.0 Request processed in 102us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530631.817769:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788530631.817864:0:23484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960fb80 x1875409555983104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530647 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530631.817878:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23484:1875409555983104:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788530631.817913:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.817918:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.817925:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02dc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.817929:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.817938:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.817950:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.817957:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffcca64e/0xb28d70e12575258f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.817972:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.817979:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.817982:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.818012:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.818018:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818027:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.818030:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.818034:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818050:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818059:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818065:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818086:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530631.818954:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.818962:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818972:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.818975:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.818980:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818989:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.818998:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819017:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819033:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788530631.819045:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530631.819049:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819056:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.819060:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819068:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819081:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819088:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc4409f/0xb28d70e125752596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819103:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530631.819107:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819125:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530631.819633:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819647:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819659:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819667:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e260aa7e/0xb28d70e12575259d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.819683:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.819684:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530631.819686:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.820345:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.820353:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.820365:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.820369:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.820375:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.820386:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.820403:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.820411:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.820424:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530631.820593:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530631.820600:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.820608:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530631.820612:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.820632:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.820647:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.820654:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000326be654/0xb28d70e1257525a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530631.820672:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.820673:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530631.820675:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.821150:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.821512:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.821519:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.821530:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.821534:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.821632:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.821643:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.821651:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.821659:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.821692:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530631.822093:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.822100:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822109:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.822113:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822121:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822136:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822144:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42f32c2/0xb28d70e1257525ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822161:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.822162:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.822164:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530631.822256:0:24247:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530631.822263:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.822271:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=839s v=(0 0) 00010000:00010000:1.0:1788530631.822274:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530631.822279:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.822288:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.822296:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.822304:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530631.822327:0:24247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788530631.822361:0:24247:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788530631.822460:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22768:x1875409555982464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69332us (69469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530631.822470:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530631.822533:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22768:1875409555982464:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1788530631.822861:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530631.822867:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822876:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530631.822885:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822894:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822906:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822913:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175f0bb0/0xb28d70e1257525b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530631.822929:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.822931:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530631.822933:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788530631.822988:0:22768:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788530631.823037:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22768:1875409555983232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788530631.823076:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530631.823109:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530631.823118:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983232 00000100:00100000:0.0:1788530631.823124:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983232 00000100:00100000:0.0:1788530631.823174:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530631.823184:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22768:x1875409555983232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788530631.823228:0:24246:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788530631.827518:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22768:x1875409555983232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4328us (4435us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788530631.827532:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530631.827584:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22768:1875409555983232:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788530631.827601:0:22768:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788530632.643077:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530633.405816:0:25417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788530633.670608:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530633.793714:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555983360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530633.793796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530633.793887:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983360 00000100:00100000:2.0:1788530633.793895:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983360 00000100:00100000:2.0:1788530633.793963:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530633.793974:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555983360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530633.794006:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530633.794077:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555983360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530633.794097:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788530633.794126:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530633.794173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555983360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530633.794673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555983488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530633.794711:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530633.794801:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983488 00000100:00100000:0.0:1788530633.794806:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983488 00000100:00100000:0.0:1788530633.794859:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530633.794870:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555983488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530633.794891:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530633.794936:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555983488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530633.794945:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788530633.795005:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530633.795182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555983488:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788530634.423188:0:25470:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530634.423808:0:25470:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530634.691517:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530634.816797:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555983616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530634.816873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530634.816918:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983616 00000100:00100000:3.0:1788530634.816929:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983616 00000100:00100000:2.0:1788530634.817033:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530634.817043:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555983616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530634.817076:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530634.817121:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555983616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530634.817128:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530634.817161:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555983616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530634.822244:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530634.822267:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555983744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530634.822340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530634.822438:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983744 00000100:00100000:0.0:1788530634.822447:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983744 00000100:00100000:0.0:1788530634.822506:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530634.822526:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555983744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530634.822586:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788530634.822657:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555983744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530634.822665:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530634.822993:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555983744:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788530635.331000:0:25520:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530635.331233:0:25520:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788530635.680419:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.680527:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724160 00000100:00100000:2.0:1788530635.680539:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724160 00000100:00100000:2.0:1788530635.680718:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:2.0:1788530635.680726:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1875409531724160:12345-192.168.202.41@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788530635.680754:0:22734:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 9117db72-dd6e-41f8-ae14-6956d4572a5d@192.168.202.41@tcp t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:2.0:1788530635.680782:0:22734:0:(genops.c:1385:class_connect()) connect: client 9117db72-dd6e-41f8-ae14-6956d4572a5d, cookie 0xb28d70e1257525b9 00000100:00080000:2.0:1788530635.680920:0:22734:0:(import.c:65:import_set_state_nolock()) ffff9a9e03716000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530635.680995:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+5:2398:x1875409531724160:12345-192.168.202.41@tcp:250:mount.lustre.0 Request processed in 267us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.681019:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:0.0:1788530635.685616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.685888:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724288 00000100:00100000:2.0:1788530635.685898:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724288 00000100:00100000:2.0:1788530635.685949:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:2.0:1788530635.685960:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+5:18139:x1875409531724288:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530635.685977:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530635.685996:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a400/0xb28d70e1257525c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e22 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.686024:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a400/0xb28d70e1257525c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e22 expref: 6 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.686036:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a400/0xb28d70e1257525c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e22 expref: 6 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.686057:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a400, rc 0) 00000100:00100000:2.0:1788530635.686115:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+6:18139:x1875409531724288:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 157us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.686123:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:3.0:1788530635.687879:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.688177:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724416 00000100:00100000:2.0:1788530635.688187:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724416 00000100:00100000:2.0:1788530635.688247:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1788530635.688259:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+6:18139:x1875409531724416:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530635.688377:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+6:18139:x1875409531724416:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 120us (505us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530635.688385:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:3.0:1788530635.690818:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.690932:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724544 00000100:00100000:0.0:1788530635.690942:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724544 00000100:00100000:0.0:1788530635.690994:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:0.0:1788530635.691003:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+6:18139:x1875409531724544:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788530635.691018:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530635.691034:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e03c64400/0xb28d70e1257525c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e29 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530635.691061:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e03c64400/0xb28d70e1257525c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e29 expref: 7 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530635.691072:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e03c64400/0xb28d70e1257525c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e29 expref: 7 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530635.691081:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e03c64400, rc 0) 00000100:00100000:0.0:1788530635.691148:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+7:18139:x1875409531724544:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 145us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.691156:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:3.0:1788530635.693743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.693839:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724672 00000100:00100000:0.0:1788530635.693850:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724672 00000100:00100000:0.0:1788530635.693960:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:0.0:1788530635.693970:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+7:18139:x1875409531724672:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530635.694133:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18139:x1875409531724672:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 163us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.694141:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:3.0:1788530635.699731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.699845:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724800 00000100:00100000:2.0:1788530635.699855:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724800 00000100:00100000:2.0:1788530635.699914:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:2.0:1788530635.699924:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18139:x1875409531724800:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530635.700073:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18139:x1875409531724800:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.700082:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:3.0:1788530635.702947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.703324:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531724928 00000100:00100000:0.0:1788530635.703333:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531724928 00000100:00100000:0.0:1788530635.703393:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:0.0:1788530635.703403:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531724928:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530635.703598:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531724928:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 195us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.703616:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00010000:00010000:0.0:1788530635.714064:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530635.722361:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.722516:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725056 00000100:00100000:0.0:1788530635.722525:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725056 00000100:00100000:0.0:1788530635.722627:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:0.0:1788530635.722638:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531725056:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530635.722794:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531725056:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 156us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.722802:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:3.0:1788530635.736981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.737079:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725184 00000100:00100000:0.0:1788530635.737091:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725184 00000100:00100000:0.0:1788530635.737152:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:0.0:1788530635.737161:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531725184:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530635.737364:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18157:x1875409531725184:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 203us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.737372:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:3.0:1788530635.743174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.743244:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725312 00000100:00100000:2.0:1788530635.743253:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725312 00000100:00100000:2.0:1788530635.743310:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:2.0:1788530635.743322:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+8:18139:x1875409531725312:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530635.743340:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530635.743360:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257525ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e5a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.743392:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257525ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e5a expref: 9 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.743403:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257525ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e5a expref: 9 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.743413:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36aa00, rc 0) 00000100:00100000:2.0:1788530635.743463:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+9:18139:x1875409531725312:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 143us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.743470:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:3.0:1788530635.745673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.745778:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725440 00000100:00100000:2.0:1788530635.745788:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725440 00000100:00100000:2.0:1788530635.745897:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1788530635.745922:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+9:18139:x1875409531725440:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788530635.745948:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788530635.745968:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530635.745973:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530635.745976:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530635.745979:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788530635.745981:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788530635.747376:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+9:18139:x1875409531725440:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 1447us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.747391:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:3.0:1788530635.749902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.750720:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725568 00000100:00100000:2.0:1788530635.750731:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725568 00000100:00100000:2.0:1788530635.750773:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:2.0:1788530635.750779:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+9:18139:x1875409531725568:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530635.750794:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530635.750809:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e61 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.750831:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 10 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.750840:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 10 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530635.750849:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ae00, rc 0) 00000100:00100000:2.0:1788530635.750980:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18139:x1875409531725568:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 199us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.750987:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:3.0:1788530635.753410:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.753466:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725696 00000100:00100000:2.0:1788530635.753475:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725696 00000100:00100000:2.0:1788530635.753628:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1788530635.753639:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18139:x1875409531725696:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530635.753827:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18139:x1875409531725696:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 189us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.753835:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:3.0:1788530635.755671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.755721:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725824 00000100:00100000:2.0:1788530635.755730:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725824 00000100:00100000:2.0:1788530635.755896:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1788530635.755907:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18139:x1875409531725824:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530635.756060:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18139:x1875409531725824:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 154us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.756068:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:3.0:1788530635.757954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.758005:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531725952 00000100:00100000:2.0:1788530635.758013:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531725952 00000100:00100000:2.0:1788530635.758220:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:2.0:1788530635.758231:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18163:x1875409531725952:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530635.758391:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18163:x1875409531725952:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 161us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530635.758404:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:3.0:1788530635.763123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.763216:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726080 00000100:00100000:0.0:1788530635.763228:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726080 00000100:00100000:0.0:1788530635.763289:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:0.0:1788530635.763299:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18163:x1875409531726080:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530635.763737:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18163:x1875409531726080:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 437us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.763968:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:3.0:1788530635.770185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530635.770269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530635.770490:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726208 00000100:00100000:1.0:1788530635.770500:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726208 00000100:00100000:1.0:1788530635.770545:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726464 00000100:00100000:1.0:1788530635.770548:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726464 00000100:00100000:1.0:1788530635.770599:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530635.770608:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875409531726208:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788530635.770639:0:22741:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 47817bd1-1880-4a60-87cb-1de1f05ea308@192.168.202.41@tcp t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:1.0:1788530635.770711:0:22741:0:(genops.c:1385:class_connect()) connect: client 47817bd1-1880-4a60-87cb-1de1f05ea308, cookie 0xb28d70e1257525dc 00000004:00100000:1.0:1788530635.770736:0:22741:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788530635.770950:0:22741:0:(import.c:65:import_set_state_nolock()) ffff9a9f3459c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530635.771006:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2398:x1875409531726208:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 398us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530635.771013:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530635.771030:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1788530635.771034:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875409531726464:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788530635.771047:0:22741:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 47817bd1-1880-4a60-87cb-1de1f05ea308@192.168.202.41@tcp t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:1.0:1788530635.771079:0:22741:0:(genops.c:1385:class_connect()) connect: client 47817bd1-1880-4a60-87cb-1de1f05ea308, cookie 0xb28d70e1257525e3 00000004:00100000:1.0:1788530635.771090:0:22741:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788530635.771414:0:22741:0:(import.c:65:import_set_state_nolock()) ffff9a9f3459d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530635.771441:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2398:x1875409531726464:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 406us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530635.771448:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530635.779068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530635.779122:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.779346:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726592 00000100:00100000:0.0:1788530635.779365:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726592 00000100:00100000:0.0:1788530635.779440:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726336 00000100:00100000:0.0:1788530635.779444:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726336 00000100:00100000:0.0:1788530635.779463:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1788530635.779473:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:0:x1875409531726592:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788530635.779512:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530635.779634:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:0:x1875409531726592:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 161us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.779641:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1788530635.779660:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:0.0:1788530635.779668:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:0:x1875409531726336:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788530635.779693:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788530635.779733:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:0:x1875409531726336:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 65us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.779752:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530635.780377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00080000:2.0:1788530635.780490:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530635.780494:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530635.780543:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726720 00000100:00100000:1.0:1788530635.780548:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726720 00000100:00100000:1.0:1788530635.780621:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1788530635.780629:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531726720:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788530635.780646:0:22741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788530635.780680:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531726720:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530635.780687:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1788530635.786532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530635.786709:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726848 00000100:00100000:1.0:1788530635.786718:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726848 00000100:00100000:1.0:1788530635.786785:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:1.0:1788530635.786795:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531726848:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788530635.786898:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531726848:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530635.786904:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1788530635.789695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.789756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530635.789792:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530635.789953:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531726976 00000100:00100000:0.0:1788530635.789964:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531726976 00000100:00100000:0.0:1788530635.790008:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727104 00000100:00100000:0.0:1788530635.790012:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727104 00000100:00100000:0.0:1788530635.790029:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530635.790037:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531726976:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788530635.790069:0:24899:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 47817bd1-1880-4a60-87cb-1de1f05ea308@192.168.202.41@tcp t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:0.0:1788530635.790103:0:24899:0:(genops.c:1385:class_connect()) connect: client 47817bd1-1880-4a60-87cb-1de1f05ea308, cookie 0xb28d70e1257525ea 00002000:00100000:0.0:1788530635.790127:0:24899:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 47817bd1-1880-4a60-87cb-1de1f05ea308/ffff9a9e0446c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530635.790144:0:24899:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530635.790306:0:24899:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788530635.790335:0:24899:0:(import.c:65:import_set_state_nolock()) ffff9a9e04468800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530635.790419:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2398:x1875409531726976:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 381us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.790427:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530635.790445:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530635.790450:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531727104:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788530635.790466:0:24899:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 47817bd1-1880-4a60-87cb-1de1f05ea308@192.168.202.41@tcp t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:0.0:1788530635.790482:0:24899:0:(genops.c:1385:class_connect()) connect: client 47817bd1-1880-4a60-87cb-1de1f05ea308, cookie 0xb28d70e1257525f1 00002000:00100000:0.0:1788530635.790488:0:24899:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 47817bd1-1880-4a60-87cb-1de1f05ea308/ffff9a9f345a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530635.790506:0:24899:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530635.790665:0:24899:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788530635.790683:0:24899:0:(import.c:65:import_set_state_nolock()) ffff9a9f36091000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530635.790711:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2398:x1875409531727104:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 259us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.790717:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530635.791086:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727232 00000100:00100000:3.0:1788530635.791092:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727232 00000100:00100000:3.0:1788530635.791194:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1788530635.791203:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531727232:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788530635.791243:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531727232:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 42us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530635.791251:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1788530635.795528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530635.795690:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727360 00000100:00100000:1.0:1788530635.795701:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727360 00000100:00100000:1.0:1788530635.795765:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1788530635.795776:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531727360:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788530635.797257:0:22744:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1368us 00000004:00200000:0.0:1788530635.831034:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788530635.831481:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18139:x1875409531727360:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 35699us (35955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530635.831499:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000040:00080000:2.0:1788530635.874016:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530636.061329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530636.062452:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727488 00000100:00100000:0.0:1788530636.062464:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727488 00000100:00100000:1.0:1788530636.062672:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1788530636.062684:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18186:x1875409531727488:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:1.0:1788530636.062708:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530636.062737:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257525f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e92 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.062815:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.062828:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.062871:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530636.062919:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530636.062923:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530636.062966:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.063177:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257525f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e92 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.063199:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e92 expref: 7 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530636.063208:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:1.0:1788530636.063210:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530636.063220:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02cc00, rc 0) 00000100:00100000:1.0:1788530636.063287:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18186:x1875409531727488:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 605us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530636.063295:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00010000:00010000:3.0:1788530636.737133:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530636.869118:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530636.869144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555983872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530636.869214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869501:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555984000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530636.869530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555984128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.869832:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869854:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555984640:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.869877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869893:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555985152:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.869916:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869935:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788530636.869941:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555984512:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.869960:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.869992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555985024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870015:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870058:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985152 00000100:00100000:3.0:1788530636.870066:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985152 00000100:00100000:3.0:1788530636.870110:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984512 00000100:00100000:3.0:1788530636.870114:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984512 00000100:00100000:3.0:1788530636.870125:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985024 00000100:00100000:3.0:1788530636.870128:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985024 00000100:00100000:3.0:1788530636.870185:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530636.870194:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555985152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870246:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555985152:12345-0@lo:400:kworker.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.870254:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530636.870271:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530636.870278:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555984512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870305:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555984512:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.870311:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530636.870322:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530636.870327:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555985024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870365:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555985024:12345-0@lo:400:kworker.0 Request processed in 38us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.870371:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530636.870402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555984256:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555984768:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870478:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555985280:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788530636.870539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555984384:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870610:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555984896:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555985408:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870656:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530636.870674:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984640 00000100:00100000:3.0:1788530636.870677:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984640 00000100:00100000:3.0:1788530636.870696:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984256 00000100:00100000:3.0:1788530636.870699:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984256 00000100:00100000:3.0:1788530636.870710:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788530636.870718:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555984640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870750:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555984640:12345-0@lo:400:kworker.0 Request processed in 32us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.870756:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788530636.870769:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530636.870775:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870821:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555984256:12345-0@lo:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.870828:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530636.870865:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555984512:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870888:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555985024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870897:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555984640:0@lo:400:kworker.0 00010000:00080000:3.0:1788530636.870908:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3c000 x1875409555985152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530636.870918:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555985152:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.870944:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985280 00000100:00100000:3.0:1788530636.870948:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985280 00000100:00100000:3.0:1788530636.870963:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984896 00000100:00100000:3.0:1788530636.870966:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984896 00000100:00100000:3.0:1788530636.870975:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985408 00000100:00100000:3.0:1788530636.870977:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985408 00000100:00100000:3.0:1788530636.870988:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530636.870993:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.871022:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555985280:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.871028:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530636.871041:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788530636.871047:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.871072:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555984896:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.871078:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788530636.871088:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530636.871094:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555985408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.871116:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555985408:12345-0@lo:400:kworker.0 Request processed in 22us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530636.871130:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530636.871156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555984896:0@lo:400:kworker.0 00010000:00080000:3.0:1788530636.871166:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3f800 x1875409555985408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530636.871175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555985408:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.871183:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555984256:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.871192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555985280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530636.871642:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555983872 00000100:00100000:0.0:1788530636.871647:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555983872 00000100:00100000:0.0:1788530636.871673:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984000 00000100:00100000:0.0:1788530636.871676:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984000 00000100:00100000:0.0:1788530636.871690:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530636.871697:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555983872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530636.871715:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788530636.871779:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555983872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530636.871785:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530636.871800:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530636.871806:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555984000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530636.871816:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788530636.871858:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555984000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530636.871864:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530636.871899:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984768 00000100:00100000:0.0:1788530636.871902:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984768 00000100:00100000:0.0:1788530636.871924:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984384 00000100:00100000:0.0:1788530636.871927:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984384 00000100:00100000:0.0:1788530636.871943:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530636.871949:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555984768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530636.871979:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555984768:12345-0@lo:400:kworker.0 Request processed in 30us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530636.871984:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530636.871995:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530636.872001:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555984384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530636.872026:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555984384:12345-0@lo:400:kworker.0 Request processed in 26us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530636.872031:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530636.872086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555984000:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788530636.872376:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530636.872381:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530636.872384:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530636.872386:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530636.873173:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555984128 00000100:00100000:1.0:1788530636.873181:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555984128 00000100:00100000:1.0:1788530636.873232:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788530636.873240:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3650:x1875409555984128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530636.873323:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3650:x1875409555984128:12345-0@lo:400:kworker.0 Request processed in 84us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530636.873330:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530636.873639:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555984128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.873801:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555984384:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.873814:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555984768:0@lo:400:kworker.0 00000100:00100000:3.0:1788530636.873834:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555983872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788530637.760840:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788530637.895022:0:25061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47817bd1-1880-4a60-87cb-1de1f05ea308 00000001:00080000:3.0:1788530637.895041:0:25061:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788530638.289136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530638.289300:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727616 00000100:00100000:3.0:1788530638.289310:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727616 00000100:00100000:3.0:1788530638.289381:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1788530638.289392:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18238:x1875409531727616:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:3.0:1788530638.289428:0:22743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530638.289525:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18238:x1875409531727616:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 127us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.289532:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:2.0:1788530638.289726:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530638.291762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530638.293974:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727744 00000100:00100000:1.0:1788530638.293988:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727744 00000100:00100000:1.0:1788530638.294137:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1788530638.294155:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18238:x1875409531727744:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:1.0:1788530638.294193:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530638.295823:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18238:x1875409531727744:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 1656us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.295835:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00080000:2.0:1788530638.299504:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530638.303212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.303343:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531727872 00000100:00100000:0.0:1788530638.303353:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531727872 00000100:00100000:0.0:1788530638.303421:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:0.0:1788530638.303431:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18238:x1875409531727872:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:0.0:1788530638.303461:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530638.303542:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18238:x1875409531727872:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.303550:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00080000:2.0:1788530638.304009:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530638.311728:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.317749:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728000 00000100:00100000:2.0:1788530638.317765:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728000 00000100:00100000:2.0:1788530638.317863:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1788530638.317876:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18238:x1875409531728000:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:2.0:1788530638.317911:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530638.318005:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18238:x1875409531728000:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 131us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.318013:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00080000:0.0:1788530638.318529:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530638.563707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.563816:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728128 00000100:00100000:2.0:1788530638.563827:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728128 00000100:00100000:2.0:1788530638.563890:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:2.0:1788530638.563901:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+10:18271:x1875409531728128:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530638.563921:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530638.563939:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125752606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e99 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.563971:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125752606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e99 expref: 11 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.564001:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125752606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e99 expref: 11 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.564010:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:2.0:1788530638.564070:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+11:18271:x1875409531728128:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.564077:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:1.0:1788530638.570010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.570292:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728256 00000100:00100000:0.0:1788530638.570303:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728256 00000100:00100000:0.0:1788530638.570365:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:0.0:1788530638.570376:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+11:18271:x1875409531728256:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530638.570490:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+11:18271:x1875409531728256:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 115us (489us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530638.570498:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:0.0:1788530638.573897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530638.574031:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728384 00000100:00100000:1.0:1788530638.574041:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728384 00000100:00100000:1.0:1788530638.574103:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:1.0:1788530638.574113:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+11:18271:x1875409531728384:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530638.574153:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530638.574172:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02ce00/0xb28d70e12575260d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ea0 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.574200:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02ce00/0xb28d70e12575260d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ea0 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.574210:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02ce00/0xb28d70e12575260d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ea0 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.574218:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02ce00, rc 0) 00000100:00100000:1.0:1788530638.574529:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531728384:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 416us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.574537:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:1.0:1788530638.579157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.579310:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728512 00000100:00100000:2.0:1788530638.579320:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728512 00000100:00100000:2.0:1788530638.579375:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:2.0:1788530638.579384:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531728512:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530638.579543:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531728512:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 159us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.579605:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:3.0:1788530638.586882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.587045:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728640 00000100:00100000:0.0:1788530638.587056:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728640 00000100:00100000:0.0:1788530638.587111:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:0.0:1788530638.587122:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531728640:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788530638.587274:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531728640:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 153us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.587292:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:0.0:1788530638.599267:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530638.599606:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728768 00000100:00100000:1.0:1788530638.599616:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728768 00000100:00100000:1.0:1788530638.599671:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1788530638.599680:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531728768:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530638.599846:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531728768:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 166us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.599855:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1788530638.630507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.630613:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531728896 00000100:00100000:2.0:1788530638.630623:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531728896 00000100:00100000:2.0:1788530638.630675:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:2.0:1788530638.630685:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531728896:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530638.630854:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531728896:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 169us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.630862:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:3.0:1788530638.638743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.639026:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729024 00000100:00100000:0.0:1788530638.639036:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729024 00000100:00100000:0.0:1788530638.639098:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530638.639109:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531729024:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530638.639296:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18278:x1875409531729024:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 188us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.639304:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530638.648292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530638.648859:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729152 00000100:00100000:1.0:1788530638.648872:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729152 00000100:00100000:1.0:1788530638.648931:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1788530638.648942:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18271:x1875409531729152:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530638.648969:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530638.648988:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ed1 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.649017:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed1 expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.649028:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02c800/0xb28d70e125752614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed1 expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.649038:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02c800, rc 0) 00000100:00100000:1.0:1788530638.649192:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18271:x1875409531729152:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 250us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.649200:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1788530638.651983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.652094:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729280 00000100:00100000:2.0:1788530638.652105:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729280 00000100:00100000:2.0:1788530638.652248:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:2.0:1788530638.652259:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18271:x1875409531729280:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788530638.652304:0:22733:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788530638.652321:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530638.652326:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530638.652328:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530638.652331:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788530638.652334:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788530638.655360:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18271:x1875409531729280:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 3094us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.655374:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:1.0:1788530638.659414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.659740:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729408 00000100:00100000:2.0:1788530638.659750:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729408 00000100:00100000:2.0:1788530638.659898:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:2.0:1788530638.659909:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18271:x1875409531729408:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530638.659926:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530638.659944:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ed8 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.659972:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 14 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.659983:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 14 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530638.659992:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36bc00, rc 0) 00000100:00100000:2.0:1788530638.660052:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18271:x1875409531729408:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 144us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.660059:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:1.0:1788530638.671859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.673275:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729536 00000100:00100000:2.0:1788530638.673305:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729536 00000100:00100000:2.0:1788530638.673372:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:2.0:1788530638.673382:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18271:x1875409531729536:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530638.673547:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0728f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18271:x1875409531729536:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 166us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.673593:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:3.0:1788530638.675095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.675792:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729664 00000100:00100000:2.0:1788530638.675801:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729664 00000100:00100000:2.0:1788530638.675855:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:2.0:1788530638.675863:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18271:x1875409531729664:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530638.675991:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18271:x1875409531729664:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 128us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.675998:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:1.0:1788530638.683652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.683743:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729792 00000100:00100000:0.0:1788530638.683753:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729792 00000100:00100000:0.0:1788530638.683809:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1788530638.683827:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18282:x1875409531729792:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530638.683973:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18282:x1875409531729792:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 155us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.683980:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:1.0:1788530638.692117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.692288:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531729920 00000100:00100000:0.0:1788530638.692298:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531729920 00000100:00100000:0.0:1788530638.692353:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1788530638.692363:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18282:x1875409531729920:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530638.692613:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18282:x1875409531729920:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 250us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.692621:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1788530638.700317:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.700390:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730048 00000100:00100000:0.0:1788530638.700402:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730048 00000100:00100000:3.0:1788530638.700406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.700505:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730304 00000100:00100000:0.0:1788530638.700509:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730304 00000100:00100000:2.0:1788530638.700630:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530638.700642:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875409531730048:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788530638.700670:0:22742:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 61b37dc8-5734-46d9-b545-32d4d8a1ace4@192.168.202.41@tcp t0 exp 0000000000000000 cur 846 last 0 00000020:00000080:2.0:1788530638.700708:0:22742:0:(genops.c:1385:class_connect()) connect: client 61b37dc8-5734-46d9-b545-32d4d8a1ace4, cookie 0xb28d70e125752622 00000004:00100000:2.0:1788530638.700733:0:22742:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788530638.700824:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9a9e03711800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530638.700888:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2398:x1875409531730048:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 248us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.700896:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530638.700915:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1788530638.700919:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875409531730304:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788530638.700950:0:22742:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 61b37dc8-5734-46d9-b545-32d4d8a1ace4@192.168.202.41@tcp t0 exp 0000000000000000 cur 846 last 0 00000020:00000080:2.0:1788530638.700974:0:22742:0:(genops.c:1385:class_connect()) connect: client 61b37dc8-5734-46d9-b545-32d4d8a1ace4, cookie 0xb28d70e125752629 00000004:00100000:2.0:1788530638.700985:0:22742:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788530638.701028:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9a9e03710000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530638.701054:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2398:x1875409531730304:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 132us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.701062:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1788530638.706375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530638.706596:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730944 00000100:00100000:2.0:1788530638.706606:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730944 00000100:00100000:2.0:1788530638.706661:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731072 00000100:00100000:2.0:1788530638.706665:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731072 00000100:00100000:2.0:1788530638.706687:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1788530638.706697:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531730944:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530638.706771:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531730944:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.706779:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1788530638.706795:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1788530638.706801:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531731072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530638.706822:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531731072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.706840:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530638.707122:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730688 00000100:00100000:3.0:1788530638.707127:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730688 00000100:00100000:3.0:1788530638.707149:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730816 00000100:00100000:3.0:1788530638.707152:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730816 00000100:00100000:3.0:1788530638.707165:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730560 00000100:00100000:3.0:1788530638.707167:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730560 00000100:00100000:3.0:1788530638.707195:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730176 00000100:00100000:3.0:1788530638.707197:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730176 00000100:00100000:3.0:1788530638.707205:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531730432 00000100:00100000:3.0:1788530638.707207:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531730432 00000100:00100000:3.0:1788530638.707220:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1788530638.707225:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531730688:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530638.707268:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531730688:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.707275:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1788530638.707287:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530638.707293:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531730816:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530638.707312:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531730816:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.707317:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530638.707326:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530638.707331:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+7:18271:x1875409531730560:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530638.707347:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530638.707383:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+7:18271:x1875409531730560:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 52us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.707389:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530638.707400:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1788530638.707405:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:0:x1875409531730176:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530638.707414:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530638.707430:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:0:x1875409531730176:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.707436:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1788530638.707445:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530638.707450:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:0:x1875409531730432:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530638.707460:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530638.707481:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:0:x1875409531730432:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 30us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.707486:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00080000:2.0:1788530638.707776:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530638.707781:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530638.717904:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530638.717974:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731200 00000100:00100000:3.0:1788530638.717985:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731200 00000100:00100000:3.0:1788530638.718041:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530638.718051:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731200:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788530638.718194:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731200:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.718202:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530638.727422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.727459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530638.727538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530638.727588:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731584 00000100:00100000:3.0:1788530638.727598:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731584 00000100:00100000:3.0:1788530638.727668:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530638.727691:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731584:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788530638.727768:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731584:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 79us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.727776:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1788530638.732533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530638.733324:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731712 00000100:00100000:3.0:1788530638.733335:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731712 00000100:00100000:3.0:1788530638.733391:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1788530638.733401:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731712:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788530638.733483:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788530638.733586:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18271:x1875409531731712:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 185us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530638.733594:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1788530638.744800:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731328 00000100:00100000:2.0:1788530638.744825:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731328 00000100:00100000:2.0:1788530638.744891:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731456 00000100:00100000:2.0:1788530638.744895:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731456 00000100:00100000:2.0:1788530638.744917:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1788530638.744926:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1875409531731328:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788530638.744960:0:24248:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 61b37dc8-5734-46d9-b545-32d4d8a1ace4@192.168.202.41@tcp t0 exp 0000000000000000 cur 846 last 0 00000020:00000080:2.0:1788530638.744992:0:24248:0:(genops.c:1385:class_connect()) connect: client 61b37dc8-5734-46d9-b545-32d4d8a1ace4, cookie 0xb28d70e125752630 00002000:00100000:2.0:1788530638.745003:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 61b37dc8-5734-46d9-b545-32d4d8a1ace4/ffff9a9e03716800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788530638.745015:0:24248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788530638.745082:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788530638.745115:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9a9e03714800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530638.745192:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2398:x1875409531731328:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 266us (17732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.745200:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1788530638.745217:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1788530638.745222:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1875409531731456:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788530638.745237:0:24248:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 61b37dc8-5734-46d9-b545-32d4d8a1ace4@192.168.202.41@tcp t0 exp 0000000000000000 cur 846 last 0 00000020:00000080:2.0:1788530638.745252:0:24248:0:(genops.c:1385:class_connect()) connect: client 61b37dc8-5734-46d9-b545-32d4d8a1ace4, cookie 0xb28d70e125752637 00002000:00100000:2.0:1788530638.745257:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 61b37dc8-5734-46d9-b545-32d4d8a1ace4/ffff9a9e03714000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788530638.745474:0:24248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788530638.745516:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788530638.745534:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9a9e03712000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530638.745594:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2398:x1875409531731456:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 370us (18055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530638.745602:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:0.0:1788530638.784731:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530638.886099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530638.886189:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731840 00000100:00100000:1.0:1788530638.886199:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731840 00000100:00100000:1.0:1788530638.886255:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530638.886263:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18305:x1875409531731840:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:1.0:1788530638.886284:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530638.886303:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02ca00/0xb28d70e12575263e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f09 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886424:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886449:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886460:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530638.886498:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530638.886501:0:22743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530638.886518:0:22743:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886540:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02ca00/0xb28d70e12575263e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 8 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886607:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 7 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530638.886617:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:1.0:1788530638.886619:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530638.886623:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02d800, rc 0) 00000100:00100000:1.0:1788530638.886669:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+7:18305:x1875409531731840:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 407us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.886676:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530638.912821:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530638.912846:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555985536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530638.912917:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530638.913143:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555985664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530638.913170:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530638.913290:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985536 00000100:00100000:0.0:1788530638.913298:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985536 00000100:00080000:3.0:1788530638.913401:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530638.913457:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985664 00000100:00100000:0.0:1788530638.913461:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985664 00000100:00100000:0.0:1788530638.913491:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530638.913507:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555985536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530638.913530:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788530638.913650:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530638.914468:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555985536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 962us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530638.914477:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530638.914499:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530638.914507:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555985664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530638.914519:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530638.914545:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555985664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530638.914980:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555985664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530638.914996:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555985536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530638.915091:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788530639.808901:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530639.937911:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555985792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530639.937981:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530639.938215:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985792 00000100:00100000:1.0:1788530639.938224:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985792 00000100:00100000:1.0:1788530639.938283:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530639.938293:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555985792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530639.938325:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788530639.938377:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555985792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530639.938384:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530639.938451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555985792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530639.938737:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530639.938747:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555985920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530639.938774:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530639.941915:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555985920 00000100:00100000:2.0:1788530639.941929:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555985920 00000100:00100000:2.0:1788530639.941976:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530639.941986:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555985920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530639.942022:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530639.942100:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555985920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530639.942108:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530639.942744:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555985920:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788530640.136201:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530640.832933:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788530640.964284:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 61b37dc8-5734-46d9-b545-32d4d8a1ace4 00000001:00100000:3.0:1788530640.964296:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47817bd1-1880-4a60-87cb-1de1f05ea308 00000001:00100000:2.0:1788530640.964460:0:24242:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 61b37dc8-5734-46d9-b545-32d4d8a1ace4 00000001:00100000:2.0:1788530640.964467:0:24242:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47817bd1-1880-4a60-87cb-1de1f05ea308 00000001:00100000:3.0:1788530640.964580:0:22721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 61b37dc8-5734-46d9-b545-32d4d8a1ace4 00000001:00100000:3.0:1788530640.964587:0:22721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47817bd1-1880-4a60-87cb-1de1f05ea308 00010000:00010000:0.0:1788530641.856759:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530641.986599:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555986048:0@lo:400:kworker.0 00000100:00100000:1.0:1788530641.986678:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530641.987663:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555986560:0@lo:400:kworker.0 00000100:00100000:1.0:1788530641.987708:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530641.987736:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530641.987742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555986176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530641.987765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530641.987803:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986560 00000100:00100000:1.0:1788530641.987810:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986560 00000100:00100000:1.0:1788530641.987866:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530641.987876:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555986560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530641.987927:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555986560:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530641.987934:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530641.987969:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986176 00000100:00100000:1.0:1788530641.987983:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986176 00000100:00100000:1.0:1788530641.988008:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530641.988015:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555986176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530641.988037:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788530641.988070:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555986176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530641.988077:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788530641.988092:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530641.988117:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788530641.988139:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555986176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530641.988150:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555986560:0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.991069:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555986304:0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.991141:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530641.991183:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530641.991190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555986432:0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.991213:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530641.991287:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986048 00000100:00100000:3.0:1788530641.992009:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986048 00000100:00100000:3.0:1788530641.992064:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788530641.992073:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3649:x1875409555986048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.992130:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3649:x1875409555986048:12345-0@lo:400:kworker.0 Request processed in 57us (5452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530641.992137:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788530641.992178:0:24247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986432 00000100:00100000:3.0:1788530641.992182:0:24247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986432 00000100:00100000:3.0:1788530641.992215:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530641.992222:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.992257:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555986432:12345-0@lo:400:kworker.0 Request processed in 35us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530641.992264:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530641.992284:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555986688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530641.993417:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530641.993471:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530641.993504:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555986432:0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.993544:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555986048:0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.995054:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986688 00000100:00100000:3.0:1788530641.995065:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986688 00000100:00100000:3.0:1788530641.995118:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530641.995126:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555986688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530641.995148:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788530641.995210:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555986688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530641.995217:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788530641.995243:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530641.995272:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555986688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530641.998035:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986304 00000100:00100000:3.0:1788530641.998049:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986304 00000100:00100000:3.0:1788530641.998109:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530641.998119:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530641.998205:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555986304:12345-0@lo:400:kworker.0 Request processed in 88us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530641.998212:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530641.998259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555986304:0@lo:400:kworker.0 00000100:00100000:3.0:1788530642.001350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555986816:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.001400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555987200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530642.001418:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.001430:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555986944:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.001452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530642.001457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555987328:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.001471:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555987456:0@lo:400:kworker.0 00000100:00100000:3.0:1788530642.001476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.001492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530642.001507:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986816 00000100:00100000:3.0:1788530642.001514:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986816 00000100:00100000:2.0:1788530642.001515:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.001586:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555987712:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.001607:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.002012:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788530642.002020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555987072:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.002048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.002069:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555987584:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.002091:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530642.002112:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555986944 00000100:00100000:2.0:1788530642.002116:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555986944 00000100:00100000:2.0:1788530642.002157:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530642.002166:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.002217:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555986944:12345-0@lo:400:kworker.0 Request processed in 52us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.002224:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530642.002246:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987328 00000100:00100000:2.0:1788530642.002250:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987328 00000100:00100000:2.0:1788530642.002278:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987456 00000100:00100000:2.0:1788530642.002281:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987456 00000100:00100000:2.0:1788530642.002309:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987200 00000100:00100000:2.0:1788530642.002312:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987200 00000100:00100000:2.0:1788530642.002322:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987712 00000100:00100000:2.0:1788530642.002324:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987712 00000100:00100000:2.0:1788530642.002335:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987584 00000100:00100000:2.0:1788530642.002338:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987584 00000100:00100000:2.0:1788530642.002350:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530642.002356:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555987328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530642.002514:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788530642.002534:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788530642.002916:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555987328:12345-0@lo:400:kworker.0 Request processed in 558us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.002924:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530642.003011:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530642.003022:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555987456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.003060:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555987456:12345-0@lo:400:kworker.0 Request processed in 41us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.003066:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530642.003078:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788530642.003083:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.003115:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555987200:12345-0@lo:400:kworker.0 Request processed in 31us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.003121:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788530642.003132:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530642.003139:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555987712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.003163:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555987712:12345-0@lo:400:kworker.0 Request processed in 26us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.003169:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530642.003180:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530642.003186:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555987584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.003223:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555987584:12345-0@lo:400:kworker.0 Request processed in 38us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.003229:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530642.003247:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987072 00000100:00100000:2.0:1788530642.003251:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987072 00000100:00100000:2.0:1788530642.003279:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530642.003284:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555987072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.004755:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555987072:12345-0@lo:400:kworker.0 Request processed in 1463us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.004766:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530642.006506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555986944:0@lo:400:kworker.0 00010000:00080000:2.0:1788530642.006538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a54e00 x1875409555987456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530642.006549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555987456:0@lo:400:kworker.0 00000100:00080000:2.0:1788530642.006598:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530642.006605:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530642.006608:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530642.007155:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555987072:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.007173:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555987584:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.007184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555987200:0@lo:400:kworker.0 00010000:00080000:2.0:1788530642.007197:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a55180 x1875409555987712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530642.007207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555987712:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.007256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555987328:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.015784:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530642.016187:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555986816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530642.016408:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555986816:0@lo:400:kworker.0 00000100:00100000:2.0:1788530642.016503:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555986816:12345-0@lo:400:kworker.0 Request processed in 107us (14871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530642.016513:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000001:02000400:0.0:1788530642.110064:0:25619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788530642.881297:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530643.909712:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530643.961669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961792:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961877:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961897:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530643.961923:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732480 00000100:00100000:1.0:1788530643.961933:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732480 00000100:00100000:1.0:1788530643.961981:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732992 00000100:00100000:1.0:1788530643.961985:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732992 00000100:00100000:1.0:1788530643.962000:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732352 00000100:00100000:1.0:1788530643.962002:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732352 00000100:00100000:1.0:1788530643.962017:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732864 00000100:00100000:1.0:1788530643.962019:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732864 00000100:00100000:1.0:1788530643.962053:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:1.0:1788530643.962063:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732480:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530643.962136:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732480:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 74us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530643.962143:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:1.0:1788530643.962161:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1788530643.962168:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531732992:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530643.962192:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531732992:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530643.962198:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1788530643.962265:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732224 00000100:00100000:2.0:1788530643.962279:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732224 00000100:00100000:2.0:1788530643.962303:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732736 00000100:00100000:2.0:1788530643.962305:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732736 00000100:00100000:2.0:1788530643.962329:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732096 00000100:00100000:2.0:1788530643.962332:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732096 00000100:00100000:2.0:1788530643.962343:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531732608 00000100:00100000:2.0:1788530643.962345:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531732608 00000100:00100000:2.0:1788530643.962358:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530643.962363:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530643.962391:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530643.962397:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530643.962422:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1788530643.962430:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2399:x1875409531732736:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530643.962454:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2399:x1875409531732736:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530643.962460:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1788530643.962472:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:2.0:1788530643.962478:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531732096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530643.962512:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531732096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530643.962519:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:2.0:1788530643.962531:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:2.0:1788530643.962537:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531732608:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530643.962582:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531732608:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530643.962589:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:1.0:1788530643.965101:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1788530643.965119:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530643.965235:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2399:x1875409531732352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 122us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530643.965245:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1788530643.965278:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1788530643.965286:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2399:x1875409531732864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530643.965331:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2399:x1875409531732864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 46us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530643.965338:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00080000:1.0:1788530643.965379:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530643.965384:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530643.965388:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530643.965391:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530643.966659:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531731968 00000100:00100000:0.0:1788530643.966675:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531731968 00000100:00100000:0.0:1788530643.966773:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1788530643.966783:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2399:x1875409531731968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530643.966845:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2399:x1875409531731968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 64us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530643.966851:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1788530644.035032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530644.035054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555987840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530644.035131:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530644.035185:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987840 00000100:00100000:0.0:1788530644.035193:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987840 00000100:00100000:0.0:1788530644.035247:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530644.035255:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555987840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530644.035282:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530644.035322:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555987840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530644.035328:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788530644.035347:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530644.035377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555987840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530644.038671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555987968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530644.038742:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530644.038792:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555987968 00000100:00100000:2.0:1788530644.038799:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555987968 00000100:00100000:2.0:1788530644.038846:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530644.038854:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555987968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530644.038877:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530644.038912:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555987968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530644.038918:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788530644.038937:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530644.038968:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555987968:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788530644.040371:0:25061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 61b37dc8-5734-46d9-b545-32d4d8a1ace4 00010000:00010000:0.0:1788530644.928720:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530645.056822:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530645.056845:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555988096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530645.056909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530645.057813:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988096 00000100:00100000:2.0:1788530645.057820:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988096 00000100:00100000:2.0:1788530645.057864:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530645.057872:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555988096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530645.057905:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530645.057959:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555988096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530645.057966:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530645.057995:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555988224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530645.058022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530645.058063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555988096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530645.058092:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988224 00000100:00100000:2.0:1788530645.058095:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988224 00000100:00100000:2.0:1788530645.058112:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530645.058118:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555988224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530645.058145:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788530645.058182:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555988224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530645.058189:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530645.058215:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555988224:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788530645.130902:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1788530645.872497:0:25766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4a2da110 20000000:00000080:3.0:1788530645.872514:0:25766:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9f067e2000 uarg=0000000000000000 20000000:01000000:3.0:1788530645.873345:0:25766:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530645.873354:0:25766:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530645.873359:0:25766:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788530645.876178:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788530645.876542:0:25766:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788530645.905637:0:25766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788530645.909358:0:25766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909385:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752239 expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909392:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752247 expref: 28 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909398:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909404:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909414:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909439:0:25766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909446:0:25766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909501:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909517:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 13 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909530:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988352:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530645.909663:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909671:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 13 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909680:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988480:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530645.909710:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909717:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909725:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988608:0@lo:104: 00000100:00100000:0.0:1788530645.909772:0:25766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530645.909813:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909821:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 28 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909830:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988736:0@lo:104: 00000100:00100000:0.0:1788530645.909856:0:25766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530645.909876:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 28 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909884:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 28 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909903:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988864:0@lo:104: 00010000:00010000:0.0:1788530645.909933:0:25766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 28 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530645.909941:0:25766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 28 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.909949:0:25766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988992:0@lo:104: 00000100:00100000:0.0:1788530645.909967:0:25766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530645.910356:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788530645.910376:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.910390:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.910399:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988608 00000100:00100000:3.0:1788530645.910406:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988608 00000100:00100000:3.0:1788530645.910445:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988736 00000100:00100000:3.0:1788530645.910448:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988736 00000100:00100000:3.0:1788530645.910457:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988864 00000100:00100000:3.0:1788530645.910459:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988864 00000100:00100000:3.0:1788530645.910467:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555988992 00000100:00100000:3.0:1788530645.910469:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555988992 00000100:00100000:3.0:1788530645.910490:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530645.910500:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:25766:x1875409555988608:12345-0@lo:104: 00010000:00010000:3.0:1788530645.910513:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910593:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530645.910599:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+6:25766:x1875409555988608:12345-0@lo:104: Request processed in 101us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.910605:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530645.910622:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530645.910627:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f34567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:25766:x1875409555988736:12345-0@lo:104: 00010000:00010000:3.0:1788530645.910635:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910682:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788530645.910688:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f34567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+5:25766:x1875409555988736:12345-0@lo:104: Request processed in 61us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.910694:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530645.910737:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530645.910744:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:25766:x1875409555988864:12345-0@lo:104: 00010000:00010000:3.0:1788530645.910764:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910798:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788530645.910803:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+4:25766:x1875409555988864:12345-0@lo:104: Request processed in 61us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.910808:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530645.910821:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530645.910826:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:25766:x1875409555988992:12345-0@lo:104: 00010000:00010000:3.0:1788530645.910834:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910859:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788530645.910864:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+3:25766:x1875409555988992:12345-0@lo:104: Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.910869:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788530645.910884:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788530645.910889:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910907:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530645.910911:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910919:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530645.910926:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530645.910931:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788530645.910963:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910970:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530645.910991:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.910997:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e12575244d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752454 expref: -99 pid: 25060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911010:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788530645.911013:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911018:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530645.911021:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911039:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530645.911045:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530645.911050:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788530645.911065:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911070:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530645.911076:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911083:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257522a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257522a9 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911091:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530645.911094:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911099:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530645.911101:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911107:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530645.911112:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530645.911123:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788530645.911135:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911140:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530645.911156:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911162:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125752247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575224e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911171:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530645.911174:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911180:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530645.911182:0:22730:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911188:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530645.911194:0:22730:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530645.911199:0:22730:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788530645.911210:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911216:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530645.911228:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911234:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e125752239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125752240 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911247:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530645.911249:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530645.911251:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530645.911258:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530645.911264:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530645.911282:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555989120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.911316:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.911347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530645.911353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555989248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.911376:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.911404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.911424:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.911441:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530645.911446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.911466:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530645.911509:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989120 00000100:00100000:3.0:1788530645.911514:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989120 00010000:00010000:3.0:1788530645.911534:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 29 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530645.911548:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989248 00000100:00100000:3.0:1788530645.911551:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989248 00010000:00010000:3.0:1788530645.911584:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 30 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530645.911604:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989376 00000100:00100000:3.0:1788530645.911607:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989376 00010000:00010000:3.0:1788530645.911618:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 31 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530645.911629:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989504 00000100:00100000:3.0:1788530645.911631:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989504 00010000:00010000:3.0:1788530645.911640:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 32 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530645.911651:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530645.911657:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+32:3647:x1875409555989120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530645.911666:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530645.911671:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 32 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911680:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 32 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911697:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530645.911723:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+32:3647:x1875409555989120:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.911730:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530645.911742:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530645.911748:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+31:3647:x1875409555989248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530645.911755:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530645.911759:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 31 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911778:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 31 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911787:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530645.911808:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+31:3647:x1875409555989248:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.911813:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530645.911844:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530645.911850:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+30:3649:x1875409555989376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530645.911856:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530645.911860:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 30 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911868:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 30 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911877:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530645.911898:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+30:3649:x1875409555989376:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.911903:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530645.911914:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530645.911919:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3649:x1875409555989504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530645.911926:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530645.911929:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 29 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911937:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 29 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.911952:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530645.911971:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3649:x1875409555989504:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530645.911977:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530645.912016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.912024:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.912044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555989248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530645.912051:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3647:1875409555989120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530645.915692:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125752454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575244d expref: 28 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.915715:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988608:0@lo:104: 00010000:00010000:0.0:1788530645.915728:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141400/0xb28d70e1257522a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257522a2 expref: 27 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.915765:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988736:0@lo:104: 00010000:00010000:0.0:1788530645.915779:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575224e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125752247 expref: 26 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.915788:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988864:0@lo:104: 00010000:00010000:0.0:1788530645.915796:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141800/0xb28d70e125752240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125752239 expref: 25 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530645.915803:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988992:0@lo:104: 00000100:00100000:1.0:1788530645.926480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530645.926605:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530645.926640:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733120 00000100:00100000:1.0:1788530645.926649:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733120 00010000:00010000:1.0:1788530645.926686:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 14 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530645.926716:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733248 00000100:00100000:1.0:1788530645.926719:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733248 00010000:00010000:1.0:1788530645.926730:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 15 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530645.926750:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530645.926759:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9117db72-dd6e-41f8-ae14-6956d4572a5d+15:2400:x1875409531733120:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530645.926773:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530645.926779:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 15 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926791:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 15 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926811:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530645.926857:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9117db72-dd6e-41f8-ae14-6956d4572a5d+15:2400:x1875409531733120:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530645.926865:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530645.926882:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1788530645.926903:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2399:x1875409531733248:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530645.926910:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530645.926922:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 14 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926930:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 14 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926943:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926952:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926966:0:22726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926974:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926981:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926987:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.926993:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c65200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530645.926997:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.927005:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.927021:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530645.927031:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530645.927049:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2399:x1875409531733248:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 146us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530645.927055:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00010000:00010000:2.0:1788530645.927553:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e12575261b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ed8 expref: 13 pid: 22736 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530645.927600:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988352:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530645.927613:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257525d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e61 expref: 12 pid: 22734 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530645.927621:0:25766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25766:1875409555988480:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530645.927670:0:25766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530645.927678:0:25766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530645.927685:0:25766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530645.927691:0:25766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e03c65200/0xb28d70e12575264c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530645.957109:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530646.976771:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530647.105060:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555989632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530647.105134:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.105306:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989632 00000100:00100000:3.0:1788530647.105314:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989632 00000100:00100000:3.0:1788530647.105400:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530647.105411:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555989632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530647.105442:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788530647.105496:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555989632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.105503:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788530647.105677:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530647.105798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555989632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530647.105815:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530647.105821:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555989760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530647.105848:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.105917:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989760 00000100:00100000:3.0:1788530647.105921:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989760 00000100:00100000:3.0:1788530647.105963:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788530647.105970:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555989760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530647.105980:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788530647.106009:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555989760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.106029:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788530647.106081:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530647.106132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555989760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530647.109918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989888:0@lo:400:kworker.0 00000100:00100000:1.0:1788530647.109992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.110079:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555989888 00000100:00100000:2.0:1788530647.110087:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555989888 00000100:00100000:2.0:1788530647.110132:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788530647.110153:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:3649:x1875409555989888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.113090:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555990016:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.113159:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.113231:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990016 00000100:00100000:3.0:1788530647.113239:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990016 00000100:00100000:3.0:1788530647.113281:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530647.113289:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555990016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.113338:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555990016:12345-0@lo:400:kworker.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.113576:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530647.113620:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555990016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.123586:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:3649:x1875409555989888:12345-0@lo:400:kworker.0 Request processed in 13424us (13583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.123603:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788530647.132283:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530647.132307:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555990400:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.132334:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555990272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.132393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555990144:0@lo:400:kworker.0 00000100:00100000:1.0:1788530647.134574:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3649:1875409555989888:0@lo:400:kworker.0 00000100:00100000:1.0:1788530647.134674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530647.134684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555990528:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.140672:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.141570:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.141640:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990272 00000100:00100000:2.0:1788530647.141650:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990272 00000100:00100000:2.0:1788530647.141700:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530647.141709:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555990272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.141766:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555990272:12345-0@lo:400:kworker.0 Request processed in 58us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.141773:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530647.141794:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990144 00000100:00100000:2.0:1788530647.141797:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990144 00000100:00100000:2.0:1788530647.141829:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530647.141836:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555990144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.141872:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555990144:12345-0@lo:400:kworker.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.141878:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530647.141917:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555990144:0@lo:400:kworker.0 00000100:00080000:2.0:1788530647.141956:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530647.142042:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555990656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.142092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555991168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.142147:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530647.142152:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555990784:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142171:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.142189:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990656 00000100:00100000:2.0:1788530647.142192:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990656 00000100:00100000:2.0:1788530647.142207:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991168 00000100:00100000:2.0:1788530647.142210:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991168 00000100:00100000:2.0:1788530647.142226:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990784 00000100:00100000:2.0:1788530647.142229:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990784 00000100:00100000:2.0:1788530647.142241:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530647.142246:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555990656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142277:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555990656:12345-0@lo:400:kworker.0 Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.142283:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530647.142295:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530647.142301:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555991168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142326:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555991168:12345-0@lo:400:kworker.0 Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.142332:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530647.142342:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788530647.142347:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555990784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142400:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555990784:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.142407:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788530647.142422:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530647.142425:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530647.142449:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555990784:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.142460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555990656:0@lo:400:kworker.0 00010000:00080000:2.0:1788530647.142470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a55880 x1875409555991168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530647.142489:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555991168:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.147653:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555990272:0@lo:400:kworker.0 00000100:00100000:0.0:1788530647.149827:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.149879:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990400 00000100:00100000:3.0:1788530647.149888:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990400 00000100:00100000:0.0:1788530647.149894:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555991040:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.149940:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788530647.149940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.149948:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555990400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530647.149964:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530647.149969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555990912:0@lo:400:kworker.0 00000100:00100000:0.0:1788530647.149990:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.150005:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555990400:12345-0@lo:400:kworker.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.150013:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788530647.150022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555990400:0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.150055:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991040 00000100:00100000:3.0:1788530647.150059:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991040 00000100:00080000:2.0:1788530647.150087:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530647.150094:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990912 00000100:00100000:3.0:1788530647.150097:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990912 00000100:00100000:2.0:1788530647.150100:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788530647.150109:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555991040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530647.150137:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530647.150142:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555990912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530647.152293:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530647.152803:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555990528 00000100:00100000:1.0:1788530647.152812:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555990528 00000100:00100000:1.0:1788530647.152862:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530647.152872:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555990528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530647.152939:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555990528:12345-0@lo:400:kworker.0 Request processed in 70us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.152947:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530647.152989:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555990528:0@lo:400:kworker.0 00000100:00080000:1.0:1788530647.153038:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530647.153043:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530647.158452:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555991040:12345-0@lo:400:kworker.0 Request processed in 8334us (8500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.158468:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530647.166884:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555990912:12345-0@lo:400:kworker.0 Request processed in 14584us (14735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.166899:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788530647.175107:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a54e00 x1875409555990912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530647.175124:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555990912:0@lo:400:kworker.0 00000100:00100000:2.0:1788530647.176124:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555991040:0@lo:400:kworker.0 10000000:01000000:3.0:1788530647.360682:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788530647.360690:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f345a9800 from 13 10000000:01000000:3.0:1788530647.360707:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530647.360754:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.360766:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.360777:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530647.360802:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530647.360872:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530647.360921:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f011ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530647.365024:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991296 00000100:00100000:0.0:1788530647.365058:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991296 00000100:00100000:0.0:1788530647.365135:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788530647.365146:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+25:22738:x1875409555991296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530647.365163:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530647.365184:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e03c64c00/0xb28d70e12575265a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752653 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.365211:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e03c64c00/0xb28d70e12575265a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752653 expref: 26 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.365224:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e03c64c00/0xb28d70e12575265a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752653 expref: 26 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.365232:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e03c64c00, rc 0) 00000100:00100000:0.0:1788530647.365310:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530647.365316:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788530647.366099:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3df90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530647.366119:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575265a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.366129:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575265a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530647.366287:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:2.0:1788530647.366623:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530647.366816:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788530647.366843:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:2.0:1788530647.366858:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:2.0:1788530647.366873:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:2.0:1788530647.366887:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:2.0:1788530647.366912:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:2.0:1788530647.366927:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:2.0:1788530647.366940:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:2.0:1788530647.366952:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:2.0:1788530647.366982:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:2.0:1788530647.366995:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:2.0:1788530647.367013:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:2.0:1788530647.367018:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:2.0:1788530647.367085:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.367136:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.367452:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.368407:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991424 00000100:00100000:1.0:1788530647.368417:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991424 00000100:00100000:1.0:1788530647.368463:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788530647.368483:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.369225:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 752us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.369235:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788530647.371723:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.371789:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.371861:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.371962:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530647.373108:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991552 00000100:00100000:0.0:1788530647.373117:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991552 00000100:00100000:0.0:1788530647.373224:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530647.373234:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.373380:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530647.373387:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788530647.373482:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530647.373915:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530647.374005:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991680:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.374046:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.383299:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.383586:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991680 00000100:00100000:1.0:1788530647.383597:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991680 00000100:00100000:1.0:1788530647.384296:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788530647.384307:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991680:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.384482:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991680:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 176us (10435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.384490:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788530647.384602:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991680:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530647.384800:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1788530647.384829:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:2.0:1788530647.384841:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:2.0:1788530647.384854:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:2.0:1788530647.384865:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:2.0:1788530647.384876:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:2.0:1788530647.384899:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:2.0:1788530647.384910:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:2.0:1788530647.384920:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:2.0:1788530647.384930:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:2.0:1788530647.384940:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:2.0:1788530647.384972:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991808:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.385012:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.385049:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.385175:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991808 00000100:00100000:1.0:1788530647.385181:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991808 00000100:00100000:1.0:1788530647.385204:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788530647.385210:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991808:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.385288:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991808:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.385303:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788530647.385780:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991808:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530647.385830:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:2.0:1788530647.385839:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788530647.388326:0:25779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 64768 count 13 00000020:01000000:0.0:1788530647.388704:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788530647.388720:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530647.388730:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575265a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.388758:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb800/0xb28d70e125752653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575265a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530647.388774:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530647.388777:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaea000 from 13 10000000:01000000:0.0:1788530647.388780:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530647.388815:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.388823:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.388835:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530647.388857:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.388923:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.388967:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.389028:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555991936 00000100:00100000:1.0:1788530647.389036:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555991936 00000100:00100000:1.0:1788530647.389084:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788530647.389094:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+26:22738:x1875409555991936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530647.389106:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.389118:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02ca00/0xb28d70e125752668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752661 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.389138:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02ca00/0xb28d70e125752668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752661 expref: 27 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.389149:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02ca00/0xb28d70e125752668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752661 expref: 27 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.389157:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02ca00, rc 0) 00000100:00100000:1.0:1788530647.389195:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555991936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.389200:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788530647.389753:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555991936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530647.389781:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752668 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.389790:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752668 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530647.389945:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000040:00080000:2.0:1788530647.390193:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530647.390356:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:2.0:1788530647.390381:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:2.0:1788530647.390395:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:2.0:1788530647.390412:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:2.0:1788530647.390426:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:2.0:1788530647.390440:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:2.0:1788530647.390452:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:2.0:1788530647.390465:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:2.0:1788530647.390504:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:2.0:1788530647.390519:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:2.0:1788530647.390534:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:2.0:1788530647.390553:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:2.0:1788530647.390582:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 12 count 13 00000100:00100000:2.0:1788530647.391250:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.391319:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.391360:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.391441:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992064 00000100:00100000:1.0:1788530647.391449:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992064 00000100:00100000:1.0:1788530647.391502:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788530647.391510:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.392004:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 493us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.392013:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788530647.392164:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.392200:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.392243:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.392272:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530647.395753:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992192 00000100:00100000:0.0:1788530647.395769:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992192 00000100:00100000:0.0:1788530647.395843:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788530647.395853:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.396023:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530647.396031:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788530647.396312:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530647.396805:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530647.396898:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992320:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.396952:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530647.396989:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530647.397256:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992320 00000100:00100000:2.0:1788530647.397262:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992320 00000100:00100000:2.0:1788530647.397296:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788530647.397304:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992320:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.397405:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992320:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 101us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.397413:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788530647.398686:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992320:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530647.398896:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1788530647.398925:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:1.0:1788530647.398940:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:1.0:1788530647.398954:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:1.0:1788530647.398967:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:1.0:1788530647.398980:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:1.0:1788530647.398992:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:1.0:1788530647.399006:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:1.0:1788530647.399020:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:1.0:1788530647.399035:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:1.0:1788530647.399049:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:1.0:1788530647.399079:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992448:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.399131:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530647.399172:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530647.399321:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992448 00000100:00100000:2.0:1788530647.399327:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992448 00000100:00100000:2.0:1788530647.399373:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788530647.399382:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992448:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.399494:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992448:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.399502:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788530647.399602:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f33afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992448:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530647.399658:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:0.0:1788530647.399672:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788530647.400789:0:25780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 13 00000020:01000000:0.0:1788530647.400984:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788530647.400997:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530647.401007:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752668 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.401017:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e03c64e00/0xb28d70e125752661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752668 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530647.401032:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530647.401035:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03d6c000 from 13 10000000:01000000:0.0:1788530647.401038:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530647.401069:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.401077:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.401087:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530647.401107:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.401155:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.401198:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.401714:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992576 00000100:00100000:1.0:1788530647.401722:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992576 00000100:00100000:1.0:1788530647.401768:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788530647.401777:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+27:22738:x1875409555992576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530647.401790:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.401803:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3b02c400/0xb28d70e125752676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575266f expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.401825:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3b02c400/0xb28d70e125752676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575266f expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.401850:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3b02c400/0xb28d70e125752676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575266f expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.401859:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02c400, rc 0) 00000100:00100000:1.0:1788530647.401898:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.401905:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788530647.401996:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530647.402012:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752676 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.402022:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125752676 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530647.402142:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 13 count 13 00000040:00080000:0.0:1788530647.402529:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530647.402890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.403194:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733376 00000100:00100000:1.0:1788530647.403201:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733376 00000100:00100000:1.0:1788530647.403252:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1788530647.403261:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+6:18772:x1875409531733376:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530647.403276:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.403290:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02dc00/0xb28d70e12575267d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f10 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403344:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403356:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403368:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403382:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403389:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403405:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403484:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c200/0xb28d70e125752692 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403492:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c200/0xb28d70e125752692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403499:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c200/0xb28d70e125752692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530647.403527:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530647.403531:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530647.403590:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c200/0xb28d70e125752692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.403602:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530647.403850:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:0.0:1788530647.403887:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 112 off8528 00000040:00080000:0.0:1788530647.403901:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 224 off8752 00000040:00080000:0.0:1788530647.403914:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8976 00000040:00080000:0.0:1788530647.403927:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 112 off9088 00000040:00080000:0.0:1788530647.403940:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 224 off9312 00000040:00080000:0.0:1788530647.403952:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 224 off9536 00000040:00080000:0.0:1788530647.403966:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 128 off9664 00000040:00080000:0.0:1788530647.403978:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:0.0:1788530647.403990:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 224 off10112 00000040:00080000:0.0:1788530647.404003:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 128 off10240 00000040:00080000:0.0:1788530647.404022:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 224 off10464 00000040:00080000:0.0:1788530647.404028:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 12 count 13 00000100:00100000:0.0:1788530647.404106:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.404150:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.404182:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530647.404894:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992704 00000100:00100000:3.0:1788530647.404903:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992704 00000100:00100000:3.0:1788530647.404941:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788530647.404949:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530647.405071:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.405079:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1788530647.405536:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788530647.406693:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406707:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406714:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.406719:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406729:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406761:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:1.0:1788530647.406764:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.406769:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406776:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e125752684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406794:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406801:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406807:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406813:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.406815:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406821:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406828:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a9f2b9d7a00) 00010000:00010000:1.0:1788530647.406830:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.406833:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406839:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575268b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406899:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02dc00/0xb28d70e12575267d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f10 expref: 8 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406915:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c200/0xb28d70e125752692 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f10 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.406922:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f2b9d7000) 00010000:00010000:1.0:1788530647.406924:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530647.406927:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02c200, rc 0) 00000100:00100000:1.0:1788530647.406991:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18772:x1875409531733376:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 3730us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.406998:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530647.407136:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.407187:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.407245:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.407279:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530647.408104:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992832 00000100:00100000:3.0:1788530647.408124:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992832 00000100:00100000:3.0:1788530647.408180:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788530647.408189:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530647.408313:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.408320:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788530647.409851:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530647.410271:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530647.410347:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992960:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.410410:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.410462:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.410833:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555992960 00000100:00100000:1.0:1788530647.410840:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555992960 00000100:00100000:1.0:1788530647.410876:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788530647.410884:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992960:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.410984:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555992960:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 100us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.410991:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530647.411136:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555992960:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530647.411296:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:0.0:1788530647.411322:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 112 off8528 00000040:00080000:0.0:1788530647.411336:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 224 off8752 00000040:00080000:0.0:1788530647.411350:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8976 00000040:00080000:0.0:1788530647.411361:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 112 off9088 00000040:00080000:0.0:1788530647.411392:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 224 off9312 00000040:00080000:0.0:1788530647.411406:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 224 off9536 00000040:00080000:0.0:1788530647.411419:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 128 off9664 00000040:00080000:0.0:1788530647.411432:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:0.0:1788530647.411445:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 224 off10112 00000040:00080000:0.0:1788530647.411457:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 128 off10240 00000100:00100000:0.0:1788530647.411492:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993088:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.411535:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.411596:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788530647.411667:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555993088 00000100:00100000:2.0:1788530647.411671:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555993088 00000100:00100000:2.0:1788530647.411710:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788530647.411720:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555993088:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.411803:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555993088:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.411817:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788530647.411956:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993088:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530647.412008:0:22738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 224 off10464 00000040:00080000:0.0:1788530647.412016:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788530647.416175:0:25781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 64768 count 13 00000020:01000000:2.0:1788530647.416631:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530647.416647:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530647.416658:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752676 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.416670:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e03c65000/0xb28d70e12575266f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125752676 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530647.416682:0:22738:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530647.416684:0:22738:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f3b266000 from 13 10000000:01000000:2.0:1788530647.416687:0:22738:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530647.416724:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.416732:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.416742:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530647.416765:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.416838:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530647.416870:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530647.416924:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555993216 00000100:00100000:3.0:1788530647.416932:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555993216 00000100:00100000:3.0:1788530647.416979:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788530647.416989:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+28:22738:x1875409555993216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530647.417002:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.417014:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb600/0xb28d70e1257526a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125752699 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.417037:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb600/0xb28d70e1257526a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125752699 expref: 29 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.417046:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb600/0xb28d70e1257526a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125752699 expref: 29 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.417054:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:3.0:1788530647.417097:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555993216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.417103:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788530647.417229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.417304:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733504 00000100:00100000:3.0:1788530647.417309:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733504 00000100:00100000:3.0:1788530647.417343:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1788530647.417351:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18772:x1875409531733504:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788530647.417411:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18772:x1875409531733504:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.417418:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530647.417704:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530647.417720:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257526a0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530647.417730:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257526a0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530647.417770:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.417807:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.417833:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.417874:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555993344 00000100:00100000:1.0:1788530647.417879:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555993344 00000100:00100000:1.0:1788530647.417911:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788530647.417919:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555993344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.418033:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555993344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.418047:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788530647.418429:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.418458:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.418514:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530647.418535:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530647.418605:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555993472 00000100:00100000:2.0:1788530647.418610:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555993472 00000100:00100000:2.0:1788530647.418638:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788530647.418644:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555993472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.418722:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:22738:x1875409555993472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.418734:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788530647.418834:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fdaa18b0-da07-49cb-a5c5-729ae13b1075:22738:1875409555993472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530647.419657:0:25782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788530647.419863:0:22738:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530647.419875:0:22738:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530647.419884:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257526a0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.419894:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a200/0xb28d70e125752699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257526a0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530647.434909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.434977:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733760 00000100:00100000:2.0:1788530647.434987:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733760 00000100:00100000:2.0:1788530647.435049:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1788530647.435061:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+7:18772:x1875409531733760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530647.435080:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530647.435106:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257526a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f17 expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435178:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435211:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435224:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435240:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435247:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435254:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435356:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e1257526bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435365:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e1257526bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435371:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e1257526bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530647.435380:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788530647.435532:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435540:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435546:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435558:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ae00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530647.435583:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435590:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435607:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f2b9d7000) 00010000:00010000:2.0:1788530647.435610:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530647.435615:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435621:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435635:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435641:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435647:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435653:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530647.435656:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435661:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435679:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a9f125c6700) 00010000:00010000:2.0:1788530647.435682:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530647.435684:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.435690:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.436595:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257526a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f17 expref: 10 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.436612:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e1257526bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f17 expref: 9 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.436621:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f125c6e00) 00010000:00010000:2.0:1788530647.436624:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530647.436627:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a000, rc 0) 00000100:00100000:2.0:1788530647.436688:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18772:x1875409531733760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1629us (1788us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788530647.436696:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1788530647.452931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.453147:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531733888 00000100:00100000:3.0:1788530647.453158:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531733888 00000100:00100000:3.0:1788530647.453215:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1788530647.453225:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18772:x1875409531733888:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788530647.453331:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18772:x1875409531733888:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.453339:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1788530647.459983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.460160:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734016 00000100:00100000:3.0:1788530647.460170:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734016 00000100:00100000:3.0:1788530647.460235:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1788530647.460243:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18772:x1875409531734016:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788530647.460329:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788530647.461121:0:22743:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 841us 00000100:00100000:1.0:1788530647.474162:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.474342:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734144 00000100:00100000:3.0:1788530647.474352:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734144 00000100:00100000:3.0:1788530647.477743:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1788530647.477768:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18778:x1875409531734144:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530647.477800:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.477826:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e1257526ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f1e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477889:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477921:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477933:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477980:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477988:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.477995:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478038:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478045:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478051:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478057:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530647.478060:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478068:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478078:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:3.0:1788530647.478087:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530647.478092:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478098:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257526d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478110:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478115:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478120:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478125:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530647.478127:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478131:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478138:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f0b171100) 00010000:00010000:3.0:1788530647.478141:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530647.478144:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478149:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478181:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e1257526ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f1e expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478196:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:3.0:1788530647.478199:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530647.478203:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e1257526ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f1e expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.478212:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eae00, rc 0) 00000100:00100000:3.0:1788530647.478274:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18778:x1875409531734144:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 518us (4119us total) trans 0 rc 301/301 00000100:00100000:3.0:1788530647.478282:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530647.486620:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18772:x1875409531734016:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 26365us (26633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.486635:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:1.0:1788530647.491298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.491385:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734272 00000100:00100000:2.0:1788530647.491395:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734272 00000100:00100000:2.0:1788530647.491456:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1788530647.491466:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18778:x1875409531734272:12345-192.168.202.41@tcp:700:lfs.0 00000100:00100000:2.0:1788530647.491584:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18778:x1875409531734272:12345-192.168.202.41@tcp:700:lfs.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.491591:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1788530647.496017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.496094:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734528 00000100:00100000:1.0:1788530647.496104:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734528 00000100:00100000:1.0:1788530647.496162:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530647.496174:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+9:18778:x1875409531734528:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:1.0:1788530647.496227:0:25613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530647.496253:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02cc00/0xb28d70e1257525ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e92 expref: 9 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.496274:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:1.0:1788530647.496278:0:25613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530647.496335:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.496348:0:25613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 5 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.496356:0:25613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.496389:0:25613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 5 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.496402:0:25613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 5 pid: 22743 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530647.496431:0:25613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875409555993600:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530647.496527:0:25613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530647.500381:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.500447:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734656 00000100:00100000:3.0:1788530647.500456:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734656 00010000:00010000:3.0:1788530647.500522:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 6 pid: 22743 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530647.500607:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530647.500618:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531734656:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530647.500632:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530647.500639:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 6 pid: 22743 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.500653:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 6 pid: 22743 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.500675:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:3.0:1788530647.500681:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.500709:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.500717:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.500737:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530647.500786:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:2399:x1875409531734656:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.500794:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00080000:1.0:1788530647.501046:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788530647.502446:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752645 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f09 expref: 5 pid: 22743 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530647.502467:0:25613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25613:1875409555993600:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530647.502502:0:25613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.502513:0:25613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.502519:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.502544:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.502556:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.502582:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.504971:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505005:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505017:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530647.505036:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f9971f4 reply state 0000000066572bba transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505048:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505056:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:2.0:1788530647.505059:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530647.505063:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788530647.505069:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530647.505078:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505085:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505091:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505097:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530647.505101:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505109:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505129:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b9d7800) 00010000:00010000:2.0:1788530647.505132:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530647.505136:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505143:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e1257526df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530647.505160:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f9971f4 reply state 0000000066572bba transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505168:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.505174:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f125c6700) 00010000:00010000:2.0:1788530647.505175:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530647.505177:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788530647.508717:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+10:18778:x1875409531734528:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 12533us (12698us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788530647.508732:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530647.646362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.646449:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734784 00000100:00100000:3.0:1788530647.646458:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734784 00000100:00100000:3.0:1788530647.646530:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:3.0:1788530647.646541:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+10:18786:x1875409531734784:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:3.0:1788530647.646604:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.646628:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e1257526f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f25 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646699:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646712:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646723:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530647.646772:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788530647.646775:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530647.646822:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646844:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e1257526f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f25 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646861:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e1257526fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f25 expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.646870:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:3.0:1788530647.646873:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530647.646877:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea600, rc 0) 00000100:00100000:3.0:1788530647.646923:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+11:18786:x1875409531734784:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 385us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.646930:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1788530647.657734:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.657864:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531734912 00000100:00100000:3.0:1788530647.657875:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531734912 00000100:00100000:3.0:1788530647.657942:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1788530647.657951:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+12:18153:x1875409531734912:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530647.657969:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.657987:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eae00/0xb28d70e125752702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f2c expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.658016:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eae00/0xb28d70e125752702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f2c expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.658029:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eae00/0xb28d70e125752702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f2c expref: 13 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.658054:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eae00, rc 0) 00000100:00100000:3.0:1788530647.658117:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531734912:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 166us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.658124:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:0.0:1788530647.660650:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.660743:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735040 00000100:00100000:1.0:1788530647.660752:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735040 00000100:00100000:1.0:1788530647.660802:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:1.0:1788530647.660811:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531735040:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530647.660976:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531735040:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 165us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.660984:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:1.0:1788530647.662988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.663073:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735168 00000100:00100000:2.0:1788530647.663082:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735168 00000100:00100000:2.0:1788530647.663132:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:2.0:1788530647.663141:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531735168:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.663269:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531735168:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.663277:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1788530647.672927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.673032:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735296 00000100:00100000:2.0:1788530647.673053:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735296 00000100:00100000:2.0:1788530647.673111:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1788530647.673120:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:18787:x1875409531735296:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530647.673138:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530647.673157:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b600/0xb28d70e125752709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f33 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673224:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ba00/0xb28d70e125752710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673238:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ba00/0xb28d70e125752710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673250:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ba00/0xb28d70e125752710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530647.673288:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530647.673291:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530647.673307:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ba00/0xb28d70e125752710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673329:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b600/0xb28d70e125752709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f33 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673344:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ba00/0xb28d70e125752710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f33 expref: 6 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.673352:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:2.0:1788530647.673354:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530647.673357:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ba00, rc 0) 00000100:00100000:2.0:1788530647.673422:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18787:x1875409531735296:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 303us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.673430:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:0.0:1788530647.676920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.677000:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735424 00000100:00100000:3.0:1788530647.677010:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735424 00000100:00100000:3.0:1788530647.677060:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1788530647.677070:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+6:18787:x1875409531735424:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530647.677089:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.677108:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f3a expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677206:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677221:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677233:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677243:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677250:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677257:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677341:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677350:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677358:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530647.677396:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788530647.677400:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530647.677419:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677431:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677438:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677444:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677450:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530647.677454:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677462:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677487:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:3.0:1788530647.677496:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530647.677502:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677508:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575271e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677522:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677528:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677533:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677539:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530647.677541:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677547:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677554:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f125c6700) 00010000:00010000:3.0:1788530647.677557:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530647.677603:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677610:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125752725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677636:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f3a expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677667:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f3a expref: 7 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.677675:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:3.0:1788530647.677677:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530647.677680:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea200, rc 0) 00000100:00100000:3.0:1788530647.677739:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+7:18787:x1875409531735424:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 670us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.677747:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:0.0:1788530647.679929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.680043:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735552 00000100:00100000:3.0:1788530647.680052:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735552 00000100:00100000:3.0:1788530647.680125:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1788530647.680136:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:18787:x1875409531735552:12345-192.168.202.41@tcp:900:lfs.0 00000100:00100000:3.0:1788530647.680250:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:18787:x1875409531735552:12345-192.168.202.41@tcp:900:lfs.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.680259:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00080000:1.0:1788530647.680365:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530647.693845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.694282:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735680 00000100:00100000:2.0:1788530647.694293:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735680 00000100:00100000:2.0:1788530647.694352:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:2.0:1788530647.694363:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+13:18153:x1875409531735680:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530647.694380:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530647.694397:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b600/0xb28d70e125752733 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f41 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.694422:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b600/0xb28d70e125752733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f41 expref: 14 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.694432:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b600/0xb28d70e125752733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f41 expref: 14 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.694440:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b600, rc 0) 00000100:00100000:2.0:1788530647.694507:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18153:x1875409531735680:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 145us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.694514:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:3.0:1788530647.696177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.696299:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531735936 00000100:00100000:2.0:1788530647.696306:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531735936 00000100:00100000:2.0:1788530647.696354:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530647.696363:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+7:18787:x1875409531735936:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530647.696379:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530647.696395:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575273a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f48 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530647.696514:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530647.696653:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575273a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f48 expref: 9 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.696668:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:2.0:1788530647.696671:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530647.696676:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575273a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f48 expref: 9 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.696690:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b200, rc 0) 00000100:00100000:2.0:1788530647.696875:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+8:18787:x1875409531735936:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 512us (704us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788530647.696882:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:1.0:1788530647.699842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530647.700035:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531736064 00000100:00100000:0.0:1788530647.700045:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531736064 00000100:00100000:0.0:1788530647.700099:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1788530647.700110:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18153:x1875409531736064:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530647.700267:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18153:x1875409531736064:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530647.700275:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:3.0:1788530647.701256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.701490:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531736320 00000100:00100000:1.0:1788530647.701499:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531736320 00000100:00100000:1.0:1788530647.701547:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1788530647.701555:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+8:18787:x1875409531736320:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:1.0:1788530647.701625:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530647.701652:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575272c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f3a expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.701670:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:1.0:1788530647.701674:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530647.701717:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.701743:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.701752:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530647.701935:0:22742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f7c475a reply state 0000000094d7c5f6 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.701947:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.701953:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:1.0:1788530647.701955:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788530647.701958:0:22742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788530647.701964:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788530647.702032:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+9:18787:x1875409531736320:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 477us (778us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788530647.702039:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:3.0:1788530647.704993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.705038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530647.705104:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531736576 00000100:00100000:0.0:1788530647.705113:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531736576 00000100:00100000:0.0:1788530647.705165:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1788530647.705199:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+9:18787:x1875409531736576:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530647.705412:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+10:18787:x1875409531736576:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 225us (429us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788530647.705421:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1788530647.705576:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531736704 00000100:00100000:2.0:1788530647.705581:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531736704 00000100:00100000:2.0:1788530647.705621:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:2.0:1788530647.705629:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18153:x1875409531736704:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530647.705714:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:18153:x1875409531736704:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 85us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530647.705721:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:3.0:1788530647.711911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.712029:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531736960 00000100:00100000:1.0:1788530647.712040:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531736960 00000100:00100000:1.0:1788530647.712102:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1788530647.712111:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+10:18787:x1875409531736960:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530647.712137:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.712157:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e12575274f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f4f expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712233:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712259:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712270:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712281:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712288:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712295:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530647.712389:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788530647.712453:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712460:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712496:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712502:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02de00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.712506:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712514:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712536:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:1.0:1788530647.712539:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.712544:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712550:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712596:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712602:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712608:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712613:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.712616:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712622:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712628:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f125c6700) 00010000:00010000:1.0:1788530647.712630:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.712633:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712638:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e12575275d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712679:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e12575274f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f4f expref: 12 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712689:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:1.0:1788530647.712691:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788530647.712695:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e12575274f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f4f expref: 12 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.712703:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02da00, rc 0) 00000100:00100000:1.0:1788530647.712757:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61b37dc8-5734-46d9-b545-32d4d8a1ace4+11:18787:x1875409531736960:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 646us (869us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788530647.712764:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1788530647.715177:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.715375:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737088 00000100:00100000:3.0:1788530647.715384:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737088 00000100:00100000:3.0:1788530647.715439:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1788530647.715450:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+11:18787:x1875409531737088:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530647.715497:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.715516:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575276b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f56 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.715781:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.715796:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.715806:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530647.715827:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788530647.715831:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530647.715847:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.715873:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575276b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.716017:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.716026:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:3.0:1788530647.716029:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530647.716032:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea800, rc 0) 00000100:00100000:3.0:1788530647.716090:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:18787:x1875409531737088:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 642us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.716097:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1788530647.721965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530647.722056:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737216 00000100:00100000:0.0:1788530647.722066:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737216 00000100:00100000:0.0:1788530647.722120:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1788530647.722131:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:18787:x1875409531737216:12345-192.168.202.41@tcp:37:lfs.0 00000100:00100000:0.0:1788530647.724989:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:18787:x1875409531737216:12345-192.168.202.41@tcp:37:lfs.0 Request processed in 2851us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530647.725002:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1788530647.730376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.730499:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737472 00000100:00100000:3.0:1788530647.730510:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737472 00000100:00100000:3.0:1788530647.730585:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530647.730596:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:18787:x1875409531737472:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530647.730829:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61b37dc8-5734-46d9-b545-32d4d8a1ace4+13:18787:x1875409531737472:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 234us (462us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788530647.730837:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530647.772960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.773118:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737600 00000100:00100000:1.0:1788530647.773128:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737600 00000100:00100000:1.0:1788530647.773198:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1788530647.773210:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+11:18795:x1875409531737600:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530647.773231:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.773258:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e125752779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f5d expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773319:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773333:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773359:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773379:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773387:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773394:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773483:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575278e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773492:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575278e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773499:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575278e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530647.773532:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530647.773536:0:25613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530647.773628:0:25613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575278e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773641:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773647:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773663:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773668:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02de00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.773673:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773680:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773691:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:1.0:1788530647.773694:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.773698:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773704:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e125752780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773717:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773724:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773729:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773898:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02d800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530647.773902:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773917:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773926:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f125c6700) 00010000:00010000:1.0:1788530647.773928:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530647.773931:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773937:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e125752787 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773964:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c600/0xb28d70e125752779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f5d expref: 13 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773978:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d000/0xb28d70e12575278e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f5d expref: 12 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.773984:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:1.0:1788530647.773987:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788530647.773989:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02d000, rc 0) 00000100:00100000:1.0:1788530647.774053:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+12:18795:x1875409531737600:12345-192.168.202.41@tcp:101:bash.0 Request processed in 844us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.774061:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1788530647.778096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.781344:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737728 00000100:00100000:3.0:1788530647.781360:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737728 00000100:00100000:3.0:1788530647.782692:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1788530647.782710:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18795:x1875409531737728:12345-192.168.202.41@tcp:900:bash.0 00000100:00100000:3.0:1788530647.782814:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:18795:x1875409531737728:12345-192.168.202.41@tcp:900:bash.0 Request processed in 109us (4728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530647.782824:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530647.791374:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530647.791485:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531737984 00000100:00100000:2.0:1788530647.791494:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531737984 00000100:00100000:2.0:1788530647.791556:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1788530647.791611:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+12:18795:x1875409531737984:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530647.791633:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530647.791667:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125752795 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f64 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.791773:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.791789:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.791800:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.791834:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.791848:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 12 pid: 22742 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530647.791862:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993728:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530647.791946:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530647.796773:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993728:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530647.796802:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530647.797920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.798279:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531738112 00000100:00100000:1.0:1788530647.798287:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531738112 00010000:00010000:1.0:1788530647.798328:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 13 pid: 22742 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530647.798398:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1788530647.798408:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+13:2400:x1875409531738112:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530647.798424:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530647.798431:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 13 pid: 22742 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798444:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 13 pid: 22742 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798474:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125752772 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f56 expref: 13 pid: 22742 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798492:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:1.0:1788530647.798497:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798507:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798514:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.798545:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530647.798611:0:22743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.798620:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530647.798642:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:2400:x1875409531738112:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 235us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.798649:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:2.0:1788530647.799408:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.799422:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.799430:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.799998:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800009:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800016:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530647.800025:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530647.800064:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800071:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800078:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800084:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530647.800088:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800109:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800121:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:2.0:1788530647.800124:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530647.800128:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800134:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575279c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530647.800146:0:22743:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf39ba14 reply state 00000000c4e4e594 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800157:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800163:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a9f125c6800) 00010000:00010000:2.0:1788530647.800165:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530647.800168:0:22743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788530647.800690:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125752795 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 15 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800706:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 14 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530647.800713:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530647.800715:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788530647.800718:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d000, rc 0) 00000100:00100000:2.0:1788530647.800852:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+15:18795:x1875409531737984:12345-192.168.202.41@tcp:101:bash.0 Request processed in 9244us (9489us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788530647.800861:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:0.0:1788530647.828056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.828267:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531738240 00000100:00100000:1.0:1788530647.828291:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531738240 00000100:00100000:1.0:1788530647.828355:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1788530647.828364:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+15:18795:x1875409531738240:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530647.828404:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530647.828426:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e1257527b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f6b expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828506:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828521:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828533:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530647.828624:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788530647.828629:0:25613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530647.828650:0:25613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828662:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828688:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d800/0xb28d70e1257527b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 17 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828711:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 16 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530647.828720:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530647.828729:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530647.828733:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02de00, rc 0) 00000100:00100000:1.0:1788530647.828795:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+16:18795:x1875409531738240:12345-192.168.202.41@tcp:101:bash.0 Request processed in 427us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530647.828802:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:2.0:1788530647.831781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.831847:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531738496 00000100:00100000:3.0:1788530647.831857:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531738496 00000100:00100000:3.0:1788530647.831917:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1788530647.831927:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+16:18795:x1875409531738496:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:3.0:1788530647.833487:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+17:18795:x1875409531738496:12345-192.168.202.41@tcp:35:bash.0 Request processed in 1555us (1709us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788530647.833504:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1788530647.963037:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530647.963180:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531738752 00000100:00100000:3.0:1788530647.963190:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531738752 00000100:00100000:3.0:1788530647.963427:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530647.963452:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+17:18805:x1875409531738752:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530647.963487:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530647.963508:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257527c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f72 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530647.963642:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788530647.963846:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257527c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f72 expref: 19 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.963861:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171100) 00010000:00010000:3.0:1788530647.963864:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530647.963870:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257527c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f72 expref: 19 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530647.963885:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eac00, rc 0) 00000100:00100000:3.0:1788530647.964055:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+18:18805:x1875409531738752:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 604us (1409us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788530647.964063:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1788530647.968940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530647.969040:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531739008 00000100:00100000:1.0:1788530647.969050:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531739008 00000100:00100000:1.0:1788530647.969107:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1788530647.969118:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+18:18805:x1875409531739008:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530647.969418:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+19:18805:x1875409531739008:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 301us (486us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788530647.969427:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00010000:00010000:3.0:1788530648.001758:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530648.010681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.010956:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531739264 00000100:00100000:2.0:1788530648.010966:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531739264 00000100:00100000:2.0:1788530648.011027:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1788530648.011038:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+19:18808:x1875409531739264:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530648.011060:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530648.011079:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257527d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f79 expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.011184:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d400/0xb28d70e1257527db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.011198:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d400/0xb28d70e1257527db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.011209:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d400/0xb28d70e1257527db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530648.011220:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530648.011684:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257527d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f79 expref: 22 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.011703:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d400/0xb28d70e1257527db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f79 expref: 21 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.011855:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.011858:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530648.011862:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d400, rc 0) 00000100:00100000:2.0:1788530648.011926:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18808:x1875409531739264:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 889us (1252us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788530648.011933:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1788530648.016807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530648.017158:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531739392 00000100:00100000:0.0:1788530648.017168:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531739392 00000100:00100000:0.0:1788530648.017288:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1788530648.017300:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18808:x1875409531739392:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1788530648.017899:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.017916:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.017926:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.017980:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.017987:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.017994:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.018000:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c65600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530648.018004:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.018011:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.018024:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:0.0:1788530648.018027:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530648.018032:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.018037:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e1257527e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530648.018105:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18808:x1875409531739392:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 806us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530648.018113:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:2.0:1788530648.032433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.032508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530648.032658:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531739648 00000100:00100000:1.0:1788530648.032669:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531739648 00000100:00100000:1.0:1788530648.032750:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530648.032760:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18808:x1875409531739648:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530648.032991:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+22:18808:x1875409531739648:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 231us (566us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788530648.032999:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1788530648.049820:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531739776 00000100:00100000:3.0:1788530648.049837:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531739776 00000100:00100000:3.0:1788530648.049913:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530648.049923:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+22:2399:x1875409531739776:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530648.049939:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530648.049965:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d400/0xb28d70e1257527db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f79 expref: 22 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530648.050007:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:3.0:1788530648.050012:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530648.050083:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+21:2399:x1875409531739776:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 161us (17573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530648.050090:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000040:00080000:3.0:1788530648.194326:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788530648.321148:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530648.399726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.399930:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740032 00000100:00100000:2.0:1788530648.399940:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740032 00000100:00100000:2.0:1788530648.400004:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1788530648.400015:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18839:x1875409531740032:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:2.0:1788530648.400038:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530648.400059:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257527f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f80 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.400163:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ce00/0xb28d70e1257527f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.400178:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ce00/0xb28d70e1257527f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.400190:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ce00/0xb28d70e1257527f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530648.400200:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530648.400374:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257527f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f80 expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.400395:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ce00/0xb28d70e1257527f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f80 expref: 23 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.400403:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.400406:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530648.400410:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91ce00, rc 0) 00000100:00100000:2.0:1788530648.400486:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18839:x1875409531740032:12345-192.168.202.41@tcp:101:cat.0 Request processed in 473us (770us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788530648.400493:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:1.0:1788530648.407514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530648.407701:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740160 00000100:00100000:3.0:1788530648.407711:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740160 00000100:00100000:3.0:1788530648.407790:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1788530648.407801:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+23:2399:x1875409531740160:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530648.407817:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530648.407842:0:23894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ce00/0xb28d70e1257527f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f80 expref: 23 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530648.407863:0:23894:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:3.0:1788530648.407869:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530648.407972:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+22:2399:x1875409531740160:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 171us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530648.407981:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530648.408037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530648.408335:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740416 00000100:00100000:3.0:1788530648.408340:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740416 00000100:00100000:3.0:1788530648.408387:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530648.408395:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+22:18839:x1875409531740416:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:3.0:1788530648.410903:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18839:x1875409531740416:12345-192.168.202.41@tcp:35:cat.0 Request processed in 2269us (3103us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788530648.410930:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1788530648.491068:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530648.492443:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740672 00000100:00100000:3.0:1788530648.492456:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740672 00000100:00100000:0.0:1788530648.492761:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1788530648.492774:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18845:x1875409531740672:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1788530648.492975:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530648.492997:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c64800/0xb28d70e125752805 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f87 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493108:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493122:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493130:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 24 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493139:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493171:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 24 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493254:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 24 pid: 25613 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530648.493327:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993856:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530648.493501:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.493510:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530648.493530:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993984:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530648.493555:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17c9f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530648.497885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530648.498116:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740800 00000100:00100000:1.0:1788530648.498126:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740800 00010000:00010000:1.0:1788530648.498167:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 25 pid: 25613 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530648.498247:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1788530648.498258:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+25:2400:x1875409531740800:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530648.498273:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530648.498280:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 25 pid: 25613 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.498294:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 25 pid: 25613 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.498315:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530648.498320:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.498328:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.498333:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530648.498386:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+25:2400:x1875409531740800:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 130us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530648.498394:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00010000:00010000:0.0:1788530648.499747:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257527bf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f6b expref: 24 pid: 25613 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530648.499766:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993856:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530648.500589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530648.501345:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22743:1875409555993984:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530648.501369:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530648.501544:0:23894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531740928 00000100:00100000:2.0:1788530648.501551:0:23894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531740928 00010000:00010000:2.0:1788530648.502783:0:23894:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530648.502864:0:23894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1788530648.502877:0:23894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+24:2399:x1875409531740928:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530648.502893:0:23894:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530648.502900:0:23894:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.502913:0:23894:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.502934:0:23894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e1257527aa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f64 expref: 24 pid: 22743 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.502969:0:23894:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.502973:0:23894:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.502982:0:23894:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.502999:0:23894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.503029:0:23894:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530648.503088:0:23894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+23:2399:x1875409531740928:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 215us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530648.503093:0:23894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:0.0:1788530648.503517:0:22743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.503527:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530648.503545:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788530648.503719:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c64800/0xb28d70e125752805 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f87 expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.503735:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65600/0xb28d70e12575280c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f87 expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530648.503744:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:0.0:1788530648.503746:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530648.503748:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e03c65600, rc 0) 00000100:00100000:0.0:1788530648.503804:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18845:x1875409531740672:12345-192.168.202.41@tcp:101:dd.0 Request processed in 11033us (12748us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788530648.503811:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:3.0:1788530648.507406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.507634:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741056 00000100:00100000:2.0:1788530648.507644:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741056 00000100:00100000:2.0:1788530648.507699:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1788530648.507708:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18845:x1875409531741056:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1788530648.507738:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530648.507767:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575281a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f8e expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507801:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507816:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507847:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507961:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575281a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 25 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507980:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.507989:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.508132:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530648.508137:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91c200, rc 0) 00000100:00100000:2.0:1788530648.508213:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+24:18845:x1875409531741056:12345-192.168.202.41@tcp:101:dd.0 Request processed in 505us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530648.508220:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:3.0:1788530648.514138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.514596:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741312 00000100:00100000:2.0:1788530648.514673:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741312 00000100:00100000:2.0:1788530648.514749:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:2.0:1788530648.514760:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+24:18845:x1875409531741312:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:2.0:1788530648.514982:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.515696:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.515712:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530648.515850:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788530648.515880:0:22742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d875ff50 reply state 00000000990d96f9 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.515893:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.515901:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.515903:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530648.515908:0:22742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530648.516744:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741312:12345-192.168.202.41@tcp:36:dd.0 Request processed in 1980us (2612us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788530648.516753:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000020:00080000:2.0:1788530648.516760:0:22742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530648.520112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.520338:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741440 00000100:00100000:2.0:1788530648.520348:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741440 00000100:00100000:2.0:1788530648.520483:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530648.520494:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741440:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1788530648.520519:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530648.520541:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575282f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f95 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.520648:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575282f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f95 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.520663:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575282f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f95 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.520703:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530648.520706:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530648.520710:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d600, rc 0) 00000100:00100000:2.0:1788530648.520767:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18845:x1875409531741440:12345-192.168.202.41@tcp:101:dd.0 Request processed in 275us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530648.520774:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1788530648.543234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530648.543301:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741696 00000100:00100000:1.0:1788530648.543311:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741696 00000100:00100000:1.0:1788530648.543385:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:1.0:1788530648.543396:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18845:x1875409531741696:12345-192.168.202.41@tcp:103:dd.0 00010000:00010000:1.0:1788530648.543411:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530648.543434:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575282f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f95 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.543477:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530648.543483:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530648.543538:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741696:12345-192.168.202.41@tcp:103:dd.0 Request processed in 143us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530648.543546:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530648.547258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530648.547377:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741824 00000100:00100000:2.0:1788530648.547387:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741824 00000100:00100000:2.0:1788530648.547454:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1788530648.547473:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741824:12345-192.168.202.41@tcp:58:dd.0 00010000:00010000:2.0:1788530648.547628:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.547646:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530648.547657:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530648.549779:0:22743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530648.549941:0:22743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788530648.550204:0:22743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788530648.550779:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741824:12345-192.168.202.41@tcp:58:dd.0 Request processed in 3303us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530648.550791:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1788530648.558948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530648.559094:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531741952 00000100:00100000:1.0:1788530648.559105:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531741952 00000100:00100000:1.0:1788530648.560340:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1788530648.560360:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+27:18845:x1875409531741952:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1788530648.560382:0:25613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530648.560404:0:25613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550f9c expref: -99 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560472:0:25613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560484:0:25613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 28 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560504:0:25613:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560517:0:25613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 28 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560531:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530648.560547:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530648.560552:0:25613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 28 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530648.560575:0:25613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02d200, rc 0) 00000100:00100000:1.0:1788530648.560658:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18845:x1875409531741952:12345-192.168.202.41@tcp:101:dd.0 Request processed in 305us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530648.560665:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00010000:00010000:3.0:1788530649.025585:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530649.064552:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.064699:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530649.064757:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742208 00000100:00100000:1.0:1788530649.064767:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742208 00000100:00100000:3.0:1788530649.064937:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742080 00000100:00100000:3.0:1788530649.064941:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742080 00000100:00100000:1.0:1788530649.064944:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:1.0:1788530649.064953:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2402:x1875409531742208:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530649.064971:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1788530649.064977:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2402:x1875409531742080:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530649.065123:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2402:x1875409531742208:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 163us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530649.065132:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00080000:2.0:1788530649.065612:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530649.067760:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f07296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9117db72-dd6e-41f8-ae14-6956d4572a5d+14:2402:x1875409531742080:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 2772us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530649.067786:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:2.0:1788530649.070031:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070116:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.070263:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742720 00000100:00100000:2.0:1788530649.070272:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742720 00000100:00080000:2.0:1788530649.070299:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530649.070342:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742592 00000100:00100000:2.0:1788530649.070345:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742592 00000100:00080000:2.0:1788530649.070356:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530649.070370:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1788530649.070380:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530649.070442:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 63us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.070449:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1788530649.070494:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:2.0:1788530649.070501:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:2401:x1875409531742592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530649.070534:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61b37dc8-5734-46d9-b545-32d4d8a1ace4+12:2401:x1875409531742592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.070541:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1788530649.070692:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742464 00000100:00100000:0.0:1788530649.070697:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742464 00000100:00100000:0.0:1788530649.070740:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742976 00000100:00100000:0.0:1788530649.070743:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742976 00000100:00100000:0.0:1788530649.070755:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742336 00000100:00100000:0.0:1788530649.070758:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742336 00000100:00100000:0.0:1788530649.070769:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531742848 00000100:00100000:0.0:1788530649.070782:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531742848 00000100:00100000:0.0:1788530649.070798:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1788530649.070805:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2401:x1875409531742464:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530649.070835:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2401:x1875409531742464:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.070842:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1788530649.070855:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530649.070861:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530649.070883:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.070889:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530649.070900:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530649.070906:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0594c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2401:x1875409531742336:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530649.070927:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0594c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2401:x1875409531742336:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.070933:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530649.071054:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530649.071061:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530649.071084:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61b37dc8-5734-46d9-b545-32d4d8a1ace4+5:2401:x1875409531742848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.071089:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00080000:2.0:1788530649.071804:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530649.071810:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530649.154359:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530649.154383:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555994112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530649.154464:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530649.154691:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555994112 00000100:00100000:0.0:1788530649.154700:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555994112 00000100:00100000:0.0:1788530649.154782:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530649.154793:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555994112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530649.154821:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530649.154877:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555994112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.154885:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530649.155147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555994112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788530649.155172:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530649.155333:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530649.155345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555994240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530649.155387:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530649.157863:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555994240 00000100:00100000:0.0:1788530649.157878:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555994240 00000100:00100000:0.0:1788530649.157965:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530649.157976:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555994240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530649.157999:0:24249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530649.158082:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555994240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.158090:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788530649.158359:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555994240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788530649.158510:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788530649.345086:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788530649.345096:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530649.345141:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788530649.345152:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788530649.345299:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22776:1875409555994368:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530649.345460:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530649.353031:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.353154:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22776:1875409555994368:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788530649.353317:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531743104 00000100:00100000:0.0:1788530649.353325:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531743104 00000100:00100000:0.0:1788530649.353395:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1788530649.353406:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18846:x1875409531743104:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1788530649.353511:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1788530649.353593:0:22743:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530649.353766:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18846:x1875409531743104:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 360us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530649.353784:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1788530649.374149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.374585:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531743232 00000100:00100000:3.0:1788530649.374597:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531743232 00000100:00100000:3.0:1788530649.374658:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1788530649.374669:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18846:x1875409531743232:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788530649.374757:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375035:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375139:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375159:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375167:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375173:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375216:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375226:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375233:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530649.375277:0:25613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788530649.375282:0:25613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530649.375299:0:25613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375309:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375316:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375323:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375328:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530649.375332:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375339:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375350:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f125c6e00) 00010000:00010000:3.0:1788530649.375359:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530649.375365:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375372:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125752844 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375388:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375394:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375399:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375405:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530649.375408:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.375413:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376353:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a9f0b171d00) 00010000:00010000:3.0:1788530649.376357:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530649.376361:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376368:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575284b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376389:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376404:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376410:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.376415:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530649.377055:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.377066:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.377077:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:3.0:1788530649.377079:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530649.377083:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.377090:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125752852 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.380350:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18846:x1875409531743232:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 5668us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.380364:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:1.0:1788530649.384102:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530649.384186:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531743488 00000100:00100000:0.0:1788530649.384196:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531743488 00000100:00100000:0.0:1788530649.384255:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:0.0:1788530649.384266:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+28:18846:x1875409531743488:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530649.384287:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530649.384307:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65a00/0xb28d70e125752859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fa3 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384410:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384537:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384551:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530649.384600:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788530649.384676:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384683:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384689:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384713:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c65800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530649.384718:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384726:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384738:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:0.0:1788530649.384742:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788530649.384747:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.384754:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65800/0xb28d70e125752860 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.389053:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65a00/0xb28d70e125752859 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fa3 expref: 30 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.389096:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f125c6e00) 00010000:00010000:2.0:1788530649.389100:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530649.389107:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65a00/0xb28d70e125752859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fa3 expref: 30 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.389126:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e03c65a00, rc 0) 00000100:00100000:2.0:1788530649.389241:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+29:18846:x1875409531743488:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 4975us (5148us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788530649.389251:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:0.0:1788530649.396745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530649.396880:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531743616 00000100:00100000:1.0:1788530649.396890:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531743616 00000100:00100000:1.0:1788530649.396985:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:1.0:1788530649.396996:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+29:18846:x1875409531743616:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788530649.397045:0:22742:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788530649.397170:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+29:18846:x1875409531743616:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 175us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530649.397177:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1788530649.401320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.401412:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531743872 00000100:00100000:2.0:1788530649.401427:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531743872 00000100:00100000:2.0:1788530649.401502:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1788530649.401513:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+29:18846:x1875409531743872:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.401534:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530649.401556:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e12575286e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550faa expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788530649.402165:0:22741:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788530649.402171:0:22741:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788530649.402187:0:22741:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788530649.402338:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e125752875 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.402352:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e125752875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.402362:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e125752875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.402425:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e12575286e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550faa expref: 32 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.402444:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e125752875 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550faa expref: 31 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.402465:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6300) 00010000:00010000:2.0:1788530649.402467:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530649.402472:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91ca00, rc 0) 00000100:00100000:2.0:1788530649.402529:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+31:18846:x1875409531743872:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1019us (1218us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788530649.402536:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1788530649.412004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.414095:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531744128 00000100:00100000:2.0:1788530649.414111:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531744128 00000100:00100000:2.0:1788530649.414187:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1788530649.414198:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+31:18846:x1875409531744128:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.414262:0:25613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530649.414290:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e125752875 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550faa expref: 31 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414311:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6300) 00010000:00010000:2.0:1788530649.414321:0:25613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530649.414344:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414359:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414385:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414400:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414407:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414414:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414472:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414479:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414485:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414491:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91da00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.414495:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414502:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414510:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:2.0:1788530649.414513:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530649.414516:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414528:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91da00/0xb28d70e125752883 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414539:0:25613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414545:0:25613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414551:0:25613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414556:0:25613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.414596:0:25613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414602:0:25613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414611:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x9aee59e8 (ffff9a9f125c6100) 00010000:00010000:2.0:1788530649.414613:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530649.414616:0:25613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.414621:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575288a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9aee59e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.416976:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+30:18846:x1875409531744128:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 2767us (4969us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530649.416988:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1788530649.427719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.427928:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531744256 00000100:00100000:2.0:1788530649.427937:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531744256 00000100:00100000:2.0:1788530649.427978:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1788530649.427987:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+30:18846:x1875409531744256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.428008:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530649.428030:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e125752891 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fb1 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428064:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91de00/0xb28d70e125752898 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428074:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91de00/0xb28d70e125752898 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428083:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91de00/0xb28d70e125752898 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428190:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e125752891 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb1 expref: 32 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428209:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91de00/0xb28d70e125752898 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb1 expref: 31 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.428219:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:2.0:1788530649.428222:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530649.428225:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91de00, rc 0) 00000100:00100000:2.0:1788530649.428288:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+31:18846:x1875409531744256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 301us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.428295:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1788530649.435115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.435332:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531744512 00000100:00100000:3.0:1788530649.435342:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531744512 00000100:00100000:3.0:1788530649.435408:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1788530649.435418:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+31:18846:x1875409531744512:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530649.435507:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.435523:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.435553:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530649.435761:0:22743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788530649.435769:0:22743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857338207565ns, next at 858338206095ns, rc = 0 00000004:00010000:3.0:1788530649.435818:0:22743:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025506345 reply state 00000000e9f46fb2 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.435831:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.435839:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:3.0:1788530649.435841:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530649.435845:0:22743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530649.435940:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+33:18846:x1875409531744512:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 523us (832us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788530649.435947:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1788530649.442517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.442610:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531744640 00000100:00100000:2.0:1788530649.442620:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531744640 00000100:00100000:2.0:1788530649.442684:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1788530649.442694:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+33:18846:x1875409531744640:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.442717:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530649.442737:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fb8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.442806:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 34 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.442821:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 34 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.442905:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:2.0:1788530649.442909:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530649.442913:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91cc00, rc 0) 00000100:00100000:2.0:1788530649.443064:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+34:18846:x1875409531744640:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 370us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.443071:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1788530649.446484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.446589:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531744768 00000100:00100000:2.0:1788530649.446600:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531744768 00000100:00100000:2.0:1788530649.446661:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530649.446672:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2400:x1875409531744768:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788530649.447070:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2400:x1875409531744768:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 399us (596us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788530649.447075:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530649.449407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.449533:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745024 00000100:00100000:2.0:1788530649.449544:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745024 00000100:00100000:2.0:1788530649.449703:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530649.449715:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+34:18846:x1875409531745024:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788530649.449921:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+35:18846:x1875409531745024:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 208us (523us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788530649.449929:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1788530649.452145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.452265:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745280 00000100:00100000:2.0:1788530649.452273:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745280 00000100:00100000:2.0:1788530649.452319:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:2.0:1788530649.452328:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+35:18846:x1875409531745280:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788530649.452498:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+35:18846:x1875409531745280:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 170us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.452506:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1788530649.454735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530649.455066:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745408 00000100:00100000:1.0:1788530649.455075:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745408 00000100:00100000:1.0:1788530649.455132:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1788530649.455143:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+35:18846:x1875409531745408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530649.455162:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530649.455183:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528ad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fbf expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455252:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455266:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455278:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530649.455325:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530649.455345:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455370:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fbf expref: 37 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455407:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fbf expref: 36 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.455416:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:1.0:1788530649.455419:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788530649.455423:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02da00, rc 0) 00000100:00100000:1.0:1788530649.455500:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+36:18846:x1875409531745408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 360us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530649.455507:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:0.0:1788530649.459313:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530649.459402:0:24899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745536 00000100:00100000:1.0:1788530649.459412:0:24899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745536 00000100:00100000:1.0:1788530649.459482:0:24899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530649.459494:0:24899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+6:2399:x1875409531745536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530649.459512:0:24899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530649.459532:0:24899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fc6 expref: -99 pid: 24899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788530649.459554:0:24899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9acfd8, blocks: 0x0 00010000:00010000:1.0:1788530649.459673:0:24899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=857s v=(0 0) 00010000:00010000:1.0:1788530649.459677:0:24899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530649.459685:0:24899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 7 pid: 24899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.459700:0:24899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 7 pid: 24899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.459728:0:24899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3b02c600, rc 0) 00000100:00100000:1.0:1788530649.459967:0:24899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531745536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 475us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530649.459973:0:24899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1788530649.461872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.462533:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745792 00000100:00100000:3.0:1788530649.462545:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745792 00000100:00100000:3.0:1788530649.462674:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1788530649.462685:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+36:18846:x1875409531745792:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530649.462827:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+36:18846:x1875409531745792:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 143us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530649.462835:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1788530649.465414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.466764:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531745920 00000100:00100000:2.0:1788530649.466778:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531745920 00000100:00100000:2.0:1788530649.466908:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1788530649.466918:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+36:18846:x1875409531745920:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788530649.471822:0:22721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788530649.471840:0:22721:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788530649.471893:0:22721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788530649.471951:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.471964:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.471991:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.471998:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3b02c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.472002:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.472010:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.472027:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:2.0:1788530649.472030:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788530649.472035:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.472041:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02c000/0xb28d70e125752748 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.472201:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+19:18846:x1875409531745920:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 5279us (6793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.473312:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:0.0:1788530649.474820:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530649.474841:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555994496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788530649.474919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530649.475057:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555994496 00000100:00100000:3.0:1788530649.475064:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555994496 00000100:00100000:3.0:1788530649.475107:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530649.475114:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555994496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788530649.475231:0:24246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788530649.475234:0:24246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788530649.475235:0:24246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788530649.475237:0:24246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788530648 -> 1788530648 00002000:00010000:3.0:1788530649.475238:0:24246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788530649.475281:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555994496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (362us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788530649.475288:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1788530649.475474:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03764380/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788530649.475480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555994496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788530649.476981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.477269:0:24247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746048 00000100:00100000:2.0:1788530649.477277:0:24247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746048 00000100:00100000:2.0:1788530649.477338:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1788530649.477349:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531746048:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788530649.477466:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531746048:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 119us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.477474:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00010000:00010000:1.0:1788530649.481779:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481797:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481806:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481813:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530649.481818:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481825:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481855:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a9f125c6700) 00010000:00010000:1.0:1788530649.481858:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530649.481864:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481871:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a600/0xb28d70e1257526e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481898:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481919:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481924:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481929:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ae00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530649.481943:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481949:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481958:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a9f125c6a00) 00010000:00010000:1.0:1788530649.481961:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530649.481964:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481969:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e1257526ed lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481992:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.481999:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482012:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482017:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36bc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530649.482027:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482033:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482040:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a9f125c6800) 00010000:00010000:1.0:1788530649.482043:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530649.482046:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482051:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36bc00/0xb28d70e1257527a3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482067:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482072:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482077:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482094:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530649.482097:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482103:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482112:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530649.482115:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530649.482124:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482131:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d000/0xb28d70e125752828 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482153:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482160:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482166:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482171:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530649.482174:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482180:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482188:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:1.0:1788530649.482191:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788530649.482194:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.482199:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e12575289f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.486342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530649.486446:0:25613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746304 00000100:00100000:1.0:1788530649.486468:0:25613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746304 00000100:00100000:1.0:1788530649.486532:0:25613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1788530649.486581:0:25613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+15:18846:x1875409531746304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788530649.486636:0:25613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530649.486662:0:25613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02da00/0xb28d70e1257528b4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fbf expref: 15 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.486680:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:1.0:1788530649.486685:0:25613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530649.486717:0:25613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528c2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.486731:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.486741:0:25613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530649.486889:0:25613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cccb5ef reply state 00000000a6163d80 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.486903:0:25613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02de00/0xb28d70e1257528c2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.486910:0:25613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:1.0:1788530649.486912:0:25613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530649.486915:0:25613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530649.487284:0:25613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+16:18846:x1875409531746304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 727us (949us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788530649.487292:0:25613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:0.0:1788530649.489821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.489944:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746432 00000100:00100000:3.0:1788530649.489953:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746432 00000100:00100000:3.0:1788530649.490011:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1788530649.490020:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2399:x1875409531746432:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788530649.490165:0:24246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788530649.490168:0:24246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788530647 00002000:00010000:3.0:1788530649.490171:0:24246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788530647 00002000:00010000:3.0:1788530649.490173:0:24246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788530648 -> 1788530647 00002000:00010000:3.0:1788530649.490176:0:24246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788530649.490230:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+8:2399:x1875409531746432:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 210us (417us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788530649.490237:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:0.0:1788530649.500615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.500733:0:24247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746560 00000100:00100000:2.0:1788530649.500745:0:24247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746560 00000100:00100000:2.0:1788530649.500805:0:24247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1788530649.500814:0:24247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+8:2400:x1875409531746560:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.500868:0:24247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500884:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.500888:0:24247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.500893:0:24247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500907:0:24247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500932:0:24247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500940:0:24247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500948:0:24247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500955:0:24247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ca00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530649.500959:0:24247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.500997:0:24247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.501013:0:24247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.501020:0:24247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059cf28cc/0xb28d70e1257528c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.501096:0:24247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+8:2400:x1875409531746560:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 281us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.501104:0:24247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530649.503704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.503794:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746816 00000100:00100000:2.0:1788530649.503803:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746816 00000100:00100000:2.0:1788530649.503877:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1788530649.503887:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+16:18846:x1875409531746816:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788530649.503974:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.504004:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.504014:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.504058:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.504090:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 16 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.504109:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555994624:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530649.504208:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788530649.507189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.507493:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555994624:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530649.507522:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530649.507920:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531746944 00000100:00100000:1.0:1788530649.507937:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531746944 00010000:00010000:1.0:1788530649.507970:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530649.508007:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530649.508013:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+17:2400:x1875409531746944:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530649.508024:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530649.508029:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508037:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508052:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91c200/0xb28d70e125752821 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f8e expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508063:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:1.0:1788530649.508067:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 16 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508073:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508078:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508083:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.508119:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530649.508168:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+16:2400:x1875409531746944:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 153us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530649.508174:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:3.0:1788530649.508489:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508497:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508726:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508740:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508746:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508768:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.508778:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 16 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530649.508788:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555994752:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530649.508828:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530649.511900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.511996:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747072 00000100:00100000:2.0:1788530649.512005:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747072 00010000:00010000:2.0:1788530649.512040:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.512074:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530649.512083:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+17:2399:x1875409531747072:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530649.512096:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530649.512102:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.512114:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 17 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.512135:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:2.0:1788530649.512153:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.512177:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.512184:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.512204:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530649.512273:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+17:2399:x1875409531747072:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.512281:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00010000:00010000:3.0:1788530649.512617:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91cc00/0xb28d70e1257528a6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fb8 expref: 16 pid: 22741 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530649.512636:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555994752:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530649.512657:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.512666:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.512672:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788530649.512772:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788530649.512895:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788530649.512949:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788530649.513039:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22742:1875409555994880:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788530649.513083:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530649.513113:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530649.513584:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555994880 00000100:00100000:2.0:1788530649.513590:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555994880 00000100:00100000:2.0:1788530649.513626:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788530649.513634:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1875409555994880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788530649.513710:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1875409555994880:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.513717:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788530649.513749:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22742:1875409555994880:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788530649.513884:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788530649.513924:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22742:1875409555995008:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788530649.513949:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530649.513968:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995008 00000100:00100000:2.0:1788530649.513971:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995008 00000100:00100000:2.0:1788530649.514000:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788530649.514006:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1875409555995008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788530649.514085:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22742:x1875409555995008:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (135us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788530649.514100:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788530649.514117:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530649.514133:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22742:1875409555995008:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788530649.514329:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514338:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514344:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514349:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.514353:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514423:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514436:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:2.0:1788530649.514438:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530649.514442:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514447:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e1257528d7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514486:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514492:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514504:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514510:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.514513:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514519:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514527:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530649.514529:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530649.514536:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 19 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514545:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 19 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514553:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 19 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.514621:0:22742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3b02d200/0xb28d70e12575283d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550f9c expref: 19 pid: 25613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.514632:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555995136:192.168.202.41@tcp:105: 00000100:00100000:2.0:1788530649.514686:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530649.518762:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.518834:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747200 00000100:00100000:3.0:1788530649.518844:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747200 00000100:00100000:3.0:1788530649.518919:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530649.518930:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+20:18845:x1875409531747200:12345-192.168.202.41@tcp:49:dd.0 00000100:00100000:2.0:1788530649.518996:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22742:1875409555995136:192.168.202.41@tcp:105: 00010000:00010000:2.0:1788530649.519046:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519057:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d800/0xb28d70e125752836 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530649.519063:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+20:18845:x1875409531747200:12345-192.168.202.41@tcp:49:dd.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530649.519075:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00010000:00010000:2.0:1788530649.519095:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519112:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519123:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519134:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519151:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519157:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519163:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ca00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.519167:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519173:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519183:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530649.519192:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530649.519196:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519201:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91ca00/0xb28d70e1257528de lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519213:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519220:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519349:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519355:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530649.519365:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519371:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519380:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:2.0:1788530649.519382:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530649.519385:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.519391:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d200/0xb28d70e1257528d0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.519557:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+19:18846:x1875409531746816:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 15670us (15864us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788530649.519600:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000020:00080000:2.0:1788530649.519604:0:22742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788530649.520125:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788530649.520130:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530649.520147:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788530649.520152:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788530649.523142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.523510:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747456 00000100:00100000:3.0:1788530649.523520:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747456 00000100:00100000:0.0:1788530649.523617:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:0.0:1788530649.523631:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+19:18846:x1875409531747456:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788530649.523970:0:22745:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788530649.524073:0:22745:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788530649.524108:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524125:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524135:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524622:0:22745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524630:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524637:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.524660:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530649.524674:0:24909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530649.524683:0:24909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.524691:0:24909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e03c65400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530649.524696:0:24909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.524704:0:24909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.524730:0:24909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a9f125c6c00) 00010000:00010000:2.0:1788530649.524734:0:24909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788530649.524739:0:24909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.524745:0:24909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e03c65400/0xb28d70e1257528e5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.524759:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530649.524761:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530649.524762:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530649.525198:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47817bd1-1880-4a60-87cb-1de1f05ea308+21:18846:x1875409531747456:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 1565us (2061us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788530649.527127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.527238:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747584 00000100:00100000:3.0:1788530649.527248:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747584 00000100:00100000:3.0:1788530649.527304:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1788530649.527315:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+22:18845:x1875409531747584:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:3.0:1788530649.527336:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530649.527354:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e1257528ec lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550fcd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527387:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257528f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527421:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257528f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527432:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257528f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527554:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e1257528ec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fcd expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527936:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257528f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fcd expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.527948:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a9f125c6600) 00010000:00010000:3.0:1788530649.527951:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788530649.527955:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eac00, rc 0) 00000100:00100000:2.0:1788530649.528061:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+23:18845:x1875409531747584:12345-192.168.202.41@tcp:101:dd.0 Request processed in 745us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.528070:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1788530649.529090:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000020:00080000:0.0:1788530649.529099:0:22745:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788530649.698437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530649.702512:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747712 00000100:00100000:3.0:1788530649.702529:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747712 00000100:00100000:3.0:1788530649.702884:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530649.702896:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+8:2402:x1875409531747712:12345-192.168.202.41@tcp:4:dd.0 00010000:00010000:3.0:1788530649.702930:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.702949:0:24251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 8 pid: 24899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.702956:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530649.702960:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530649.702977:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.703013:0:24251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 8 pid: 24899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530649.703029:0:24251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 8 pid: 24899 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530649.703044:0:24251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24251:1875409555995264:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530649.707263:0:24251:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530649.709062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.709290:0:24253:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788530649.709300:0:24253:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788530649.711072:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747840 00000100:00100000:2.0:1788530649.711097:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747840 00000100:00100000:2.0:1788530649.711731:0:25785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1788530649.711743:0:25785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+9:2401:x1875409531747840:12345-192.168.202.41@tcp:4:dd.0 00010000:00010000:2.0:1788530649.711777:0:25785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.711796:0:25785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.711800:0:25785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.711805:0:25785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.711814:0:25785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530649.717547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530649.717608:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531747968 00000100:00100000:2.0:1788530649.717617:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531747968 00010000:00010000:2.0:1788530649.717667:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 10 pid: 24899 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530649.717712:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1788530649.717722:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03df9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+10:2399:x1875409531747968:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530649.717739:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530649.717759:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 10 pid: 24899 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717772:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 10 pid: 24899 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717814:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc4409f/0xb28d70e1257528bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550fc6 expref: 10 pid: 24899 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717828:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.717832:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.717838:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717846:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717854:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.717856:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530649.717860:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717866:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530649.717896:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530649.717939:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03df9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47817bd1-1880-4a60-87cb-1de1f05ea308+9:2399:x1875409531747968:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 217us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530649.717946:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00010000:00010000:1.0:1788530649.718180:0:25785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.718190:0:25785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530649.720648:0:24251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24251:1875409555995264:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530649.720685:0:24251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.720885:0:24251:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.720894:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530649.825463:0:24242:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1788530649.825484:0:24242:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1788530649.826331:0:25785:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788530649.826338:0:25785:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788530647 -> 1788530649 00002000:00010000:1.0:1788530649.826341:0:25785:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788530647 -> 1788530649 00002000:00010000:1.0:1788530649.826343:0:25785:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788530649.826363:0:25785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826375:0:25785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826402:0:25785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826409:0:25785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530649.826413:0:25785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826422:0:25785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826442:0:25785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530649.826459:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc8a4a1b/0xb28d70e125752901 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530649.826556:0:25785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:47817bd1-1880-4a60-87cb-1de1f05ea308+7:2401:x1875409531747840:12345-192.168.202.41@tcp:4:dd.0 Request processed in 114810us (117498us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788530649.827425:0:25785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000001:00080000:2.0:1788530649.881412:0:24242:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1788530649.881691:0:24251:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788530649.881721:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881734:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881744:0:24251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881752:0:24251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530649.881757:0:24251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881767:0:24251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881786:0:24251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530649.881802:0:24251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e1257528fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530649.882089:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47817bd1-1880-4a60-87cb-1de1f05ea308+5:2402:x1875409531747712:12345-192.168.202.41@tcp:4:dd.0 Request processed in 179190us (183657us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788530649.882104:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00010000:00010000:3.0:1788530650.049257:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530650.177256:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555995392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530650.177314:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555995520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530650.177326:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530650.177355:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530650.177424:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995392 00000100:00100000:1.0:1788530650.177437:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995392 00000100:00100000:2.0:1788530650.177465:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995520 00000100:00100000:2.0:1788530650.177469:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995520 00000100:00100000:1.0:1788530650.177493:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530650.177500:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555995520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530650.177532:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530650.177612:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555995520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530650.177633:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530650.177650:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788530650.177655:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555995392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530650.177668:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788530650.177697:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555995392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530650.177703:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530650.177854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555995392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530650.177854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555995520:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788530650.562169:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788530650.562177:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530650.562201:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788530650.562210:0:22776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788530651.074672:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788530651.482841:0:25822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788530652.096811:0:24909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530652.224801:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555996032:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.224836:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555996160:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.224867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530652.224891:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996160 00000100:00100000:0.0:1788530652.224898:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996160 00000100:00100000:1.0:1788530652.224901:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555996672:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.224920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530652.224935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555997184:0@lo:400:kworker.0 00000100:00100000:0.0:1788530652.224951:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996672 00000100:00100000:0.0:1788530652.224954:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996672 00000100:00100000:1.0:1788530652.224955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530652.224975:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788530652.224977:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530652.224980:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555996544:0@lo:400:kworker.0 00000100:00100000:0.0:1788530652.224998:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555996160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.225000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530652.225009:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555997056:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.225025:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530652.225046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530652.225046:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555996160:12345-0@lo:400:kworker.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530652.225054:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530652.225068:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996544 00000100:00100000:0.0:1788530652.225071:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996544 00000100:00100000:1.0:1788530652.225083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555996160:0@lo:400:kworker.0 00000100:00100000:0.0:1788530652.225102:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996032 00000100:00100000:0.0:1788530652.225105:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996032 00000100:00100000:1.0:1788530652.225119:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530652.225126:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555996672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530652.225129:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530652.225134:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.225161:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555996672:12345-0@lo:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530652.225167:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555996544:12345-0@lo:400:kworker.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530652.225173:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530652.225176:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788530652.225184:0:24246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530652.225190:0:24246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555996032:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788530652.225195:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530652.225198:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530652.225216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555996544:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.225224:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555996672:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.225247:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555997184 00000100:00100000:1.0:1788530652.225250:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555997184 00000100:00100000:2.0:1788530652.225294:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555995904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.225325:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.225347:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555996416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.225366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.225381:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555996928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.225399:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.225415:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:2.0:1788530652.225420:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555995648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530652.225474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.225491:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555995776:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.225514:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530652.225607:0:24246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555996032:12345-0@lo:400:kworker.0 Request processed in 416us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530652.225614:0:24246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530652.226386:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995904 00000100:00100000:3.0:1788530652.226393:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995904 00000100:00100000:3.0:1788530652.226608:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996416 00000100:00100000:3.0:1788530652.226613:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996416 00000100:00100000:3.0:1788530652.226627:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530652.226635:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555995904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.229918:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555997056 00000100:00100000:1.0:1788530652.229931:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555997056 00000100:00100000:1.0:1788530652.229964:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996928 00000100:00100000:1.0:1788530652.229966:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996928 00000100:00100000:1.0:1788530652.229990:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530652.230001:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555997184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.230092:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555997184:12345-0@lo:400:kworker.0 Request processed in 93us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530652.230099:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530652.230115:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788530652.230121:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.230150:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555997056:12345-0@lo:400:kworker.0 Request processed in 29us (5124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530652.230156:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788530652.230167:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788530652.230172:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.230199:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555996928:12345-0@lo:400:kworker.0 Request processed in 27us (4798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530652.230205:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788530652.230254:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530652.230258:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530652.230314:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788530652.230321:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03764380, transno 12884901892 00000004:00080000:1.0:1788530652.230339:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788530652.230372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555996032:0@lo:400:kworker.0 00000100:00100000:3.0:1788530652.231170:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555995904:12345-0@lo:400:kworker.0 Request processed in 4533us (5842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530652.231189:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530652.231212:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530652.231221:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555996416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530652.231256:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555996416:12345-0@lo:400:kworker.0 Request processed in 37us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530652.231263:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788530652.231785:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03cc7100 x1875409555997056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530652.231799:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555997056:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.231812:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555997184:0@lo:400:kworker.0 00000100:00100000:1.0:1788530652.231855:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530652.231867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555997440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530652.231907:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.232408:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995648 00000100:00100000:2.0:1788530652.232415:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995648 00000100:00100000:2.0:1788530652.232460:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555997440 00000100:00100000:2.0:1788530652.232463:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555997440 00000100:00100000:2.0:1788530652.232477:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530652.232485:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555995648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530652.232507:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530652.233099:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555995648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 612us (7622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.233107:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530652.233321:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530652.233329:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555997440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530652.233343:0:24250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788530652.233376:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555997440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.233382:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530652.233403:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555995776 00000100:00100000:2.0:1788530652.233408:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555995776 00000100:00100000:2.0:1788530652.233462:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788530652.233469:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3650:x1875409555995776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.233499:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdaa18b0-da07-49cb-a5c5-729ae13b1075+29:3650:x1875409555995776:12345-0@lo:400:kworker.0 Request processed in 31us (7984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.233506:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788530652.234347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fdaa18b0-da07-49cb-a5c5-729ae13b1075:3650:1875409555995776:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.234361:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555996288:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.234396:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.235092:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996288 00000100:00100000:2.0:1788530652.235097:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996288 00000100:00100000:1.0:1788530652.235111:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555997440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530652.235245:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555996800:0@lo:400:kworker.0 00000100:00100000:3.0:1788530652.235402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.255451:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555996800 00000100:00100000:2.0:1788530652.255463:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555996800 00000100:00100000:2.0:1788530652.257100:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530652.257180:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555996288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.257332:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555996288:12345-0@lo:400:kworker.0 Request processed in 220us (22935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.257340:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530652.257370:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530652.257387:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555996800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.257419:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555996800:12345-0@lo:400:kworker.0 Request processed in 33us (22017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.257434:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530652.257504:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555996800:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.257516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555997312:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.258369:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530652.258410:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555997312 00000100:00100000:2.0:1788530652.258417:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555997312 00000100:00100000:2.0:1788530652.258481:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530652.258490:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555997312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788530652.258884:0:22737:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530652.259502:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555997312:12345-0@lo:400:kworker.0 Request processed in 1013us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530652.259513:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788530652.260310:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03cc6a00 x1875409555997312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530652.260326:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555997312:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.260341:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555995904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.260352:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555996416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.260363:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555996928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530652.260411:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555995648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530652.260435:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555996288:0@lo:400:kworker.0 00010000:00010000:1.0:1788530653.121839:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15029 lines, 15029 kept, 0 dropped, 0 bad.