00010000:00010000:1.0F:1788638681.121675:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1788638682.143997:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788638682.407404:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1788638682.407427:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c739870b9c0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1788638682.407432:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7388774600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c739870b480 00000020:00080000:1.0:1788638682.407436:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7388774d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73b557bc00 00000020:00080000:1.0:1788638682.407458:0:14433:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1788638682.407628:0:14433:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788638683.170229:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638683.914450:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917662:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917692:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917713:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917729:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917746:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917835:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638683.917870:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267648 00000100:00100000:2.0:1788638683.917879:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267648 00000100:00100000:2.0:1788638683.917920:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267776 00000100:00100000:2.0:1788638683.917923:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267776 00000100:00100000:2.0:1788638683.917935:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268032 00000100:00100000:2.0:1788638683.917937:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268032 00000100:00100000:2.0:1788638683.917946:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268160 00000100:00100000:2.0:1788638683.917949:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268160 00000100:00100000:2.0:1788638683.917962:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638683.917971:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174267648:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638683.918034:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174267648:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 64us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.918042:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638683.918059:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:2.0:1788638683.918066:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+5:2363:x1875523174267776:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:2.0:1788638683.918273:0:16638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bbdf 00000100:00080000:2.0:1788638683.918284:0:16638:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638683.918322:0:16638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788638683.918881:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+2:2363:x1875523174267776:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 813us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.918891:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:2.0:1788638683.918915:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638683.918923:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6181e191-5f1a-46ec-b515-69664fc84af5+5:2363:x1875523174268032:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:2.0:1788638683.918936:0:16638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bc10 00000100:00080000:2.0:1788638683.918944:0:16638:0:(import.c:65:import_set_state_nolock()) ffff9c73ae182000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638683.918968:0:16638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1788638683.920011:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6181e191-5f1a-46ec-b515-69664fc84af5+2:2363:x1875523174268032:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 1084us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.920021:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638683.920041:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638683.920049:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6181e191-5f1a-46ec-b515-69664fc84af5+5:2363:x1875523174268160:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:2.0:1788638683.920066:0:16638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bc17 00000100:00080000:2.0:1788638683.922158:0:16638:0:(import.c:65:import_set_state_nolock()) ffff9c73ae183800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638683.922207:0:16638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788638683.922777:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6181e191-5f1a-46ec-b515-69664fc84af5+2:2363:x1875523174268160:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 2724us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.922805:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638683.922844:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267520 00000100:00100000:2.0:1788638683.922850:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267520 00000100:00100000:2.0:1788638683.922885:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267904 00000100:00100000:2.0:1788638683.922888:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267904 00000100:00100000:2.0:1788638683.922910:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:2.0:1788638683.922917:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174267520:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638683.922960:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174267520:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 44us (5267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.922967:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:2.0:1788638683.922978:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:2.0:1788638683.922993:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+6:2367:x1875523174267904:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638683.923017:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+6:2367:x1875523174267904:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 25us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638683.923022:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00080000:2.0:1788638683.923052:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638683.923056:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638683.923058:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788638683.926881:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638683.926890:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638683.927907:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788638683.930871:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267392 00000100:00100000:0.0:1788638683.930891:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267392 00000100:00100000:0.0:1788638683.930950:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 123 00000100:00100000:0.0:1788638683.930960:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174267392:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638683.931039:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174267392:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 80us (16598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638683.931046:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 123 00010000:00010000:2.0:1788638684.195525:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638684.518902:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638684.520881:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268288 00000100:00100000:1.0:1788638684.520895:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268288 00000100:00100000:2.0:1788638684.528099:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:2.0:1788638684.528113:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:14434:x1875523174268288:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788638684.528226:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:14434:x1875523174268288:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 Request processed in 115us (9332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638684.528233:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:0.0:1788638684.534273:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0F:1788638684.534356:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268544 00000100:00100000:3.0:1788638684.534385:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268544 00000100:00100000:3.0:1788638684.534439:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638684.534447:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+12:14434:x1875523174268544:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788638684.534668:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+13:14434:x1875523174268544:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 221us (404us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788638684.534675:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638684.896536:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638684.896557:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638684.896630:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638684.896751:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687168 00000100:00100000:2.0:1788638684.896759:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687168 00000100:00100000:2.0:1788638684.896859:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638684.896868:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638684.896901:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788638684.896957:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638684.896964:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638684.897168:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788638684.897488:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788638685.217392:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788638685.280279:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788638685.280287:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638685.280343:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788638685.280350:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788638685.408165:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183687424:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408243:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408308:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183687936:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408335:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408374:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788638685.408381:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408407:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408437:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183688064:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408459:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408501:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687936 00000100:00100000:1.0:1788638685.408508:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687936 00000100:00100000:1.0:1788638685.408557:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688064 00000100:00100000:1.0:1788638685.408573:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688064 00000100:00100000:1.0:1788638685.408599:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788638685.408607:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408655:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183687936:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638685.408662:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788638685.408680:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788638685.408685:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183688064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408711:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183688064:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638685.408716:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788638685.408735:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638685.408749:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638685.408775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408822:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183687808:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408840:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.408854:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638685.408859:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687680:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.408875:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638685.409001:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687296 00000100:00100000:1.0:1788638685.409005:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687296 00000100:00100000:1.0:1788638685.409039:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638685.409045:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638685.409076:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638685.409115:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638685.409132:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788638685.409151:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638685.409158:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687808 00000100:00100000:1.0:1788638685.409162:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687808 00000100:00100000:1.0:1788638685.409182:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788638685.409188:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183687808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.409217:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183687808:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638685.409223:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788638685.409263:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638685.409275:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183687808:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.409305:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183688064:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.409315:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183687936:0@lo:400:kworker.0 00000100:00100000:0.0:1788638685.409394:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687424 00000100:00100000:0.0:1788638685.409399:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687424 00000100:00100000:0.0:1788638685.409437:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788638685.409444:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183687424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638685.409487:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183687424:12345-0@lo:400:kworker.0 Request processed in 43us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638685.409492:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788638685.409526:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183687424:0@lo:400:kworker.0 00000100:00100000:2.0:1788638685.409838:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687552 00000100:00100000:2.0:1788638685.409859:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687552 00000100:00100000:2.0:1788638685.409895:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687680 00000100:00100000:2.0:1788638685.409898:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687680 00000100:00100000:2.0:1788638685.409924:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638685.409931:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183687552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638685.409987:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183687552:12345-0@lo:400:kworker.0 Request processed in 57us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638685.409994:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788638685.410013:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638685.410028:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638685.410070:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.410077:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183687680:12345-0@lo:400:kworker.0 Request processed in 54us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638685.410148:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183687680:0@lo:400:kworker.0 00000100:00100000:1.0:1788638685.421646:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000001:00100000:2.0:1788638685.991747:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00000020:00000080:2.0:1788638685.991753:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c73ae186000/6181e191-5f1a-46ec-b515-69664fc84af5 00000001:00100000:2.0:1788638685.991775:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00000020:00000080:2.0:1788638685.991777:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c73acdc2000/0a963600-85ae-4d04-99fd-4389bf419479 00000020:00000080:0.0:1788638685.991832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ae186000/6181e191-5f1a-46ec-b515-69664fc84af5 for lustre-OST0001 00000020:00000080:0.0:1788638685.991875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc2000/0a963600-85ae-4d04-99fd-4389bf419479 for lustre-OST0001 00000020:00000080:0.0:1788638685.991891:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ae183800 for lustre-OST0001 00000020:00000080:0.0:1788638685.991895:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73acdc2800 for lustre-OST0001 00010000:00010000:1.0:1788638686.240019:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638687.266053:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788638687.508200:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:0.0:1788638687.508262:0:14433:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:0.0:1788638687.508278:0:14433:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000001:00080000:1.0:1788638687.508541:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000001:00100000:0.0:1788638687.999877:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00000020:00000080:0.0:1788638687.999885:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73ae186800/6181e191-5f1a-46ec-b515-69664fc84af5 00000020:00000080:3.0:1788638688.001882:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ae186800/6181e191-5f1a-46ec-b515-69664fc84af5 for lustre-OST0000 00000020:00000080:3.0:1788638688.001933:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ae182000 for lustre-OST0000 00010000:00010000:2.0:1788638688.289896:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638689.027841:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638689.027876:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638689.027900:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638689.027925:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638689.027951:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268672 00000100:00100000:0.0:1788638689.027959:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268672 00000100:00100000:0.0:1788638689.028003:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:0.0:1788638689.028012:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174268672:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638689.028078:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174268672:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638689.028086:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:0.0:1788638689.028118:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268928 00000100:00100000:0.0:1788638689.028122:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268928 00000100:00100000:0.0:1788638689.028157:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638689.028164:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174268928:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638689.028194:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174268928:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638689.028200:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638689.028219:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174268800 00000100:00100000:0.0:1788638689.028224:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174268800 00000100:00100000:0.0:1788638689.028253:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269056 00000100:00100000:0.0:1788638689.028255:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269056 00000100:00100000:0.0:1788638689.028279:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638689.028285:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174268800:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638689.028329:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174268800:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638689.028347:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638689.028359:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:0.0:1788638689.028365:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174269056:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638689.028385:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174269056:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 21us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638689.028391:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00080000:0.0:1788638689.028648:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638689.028652:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788638689.315655:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638690.018253:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183688192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638690.018321:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638690.019200:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688192 00000100:00100000:3.0:1788638690.019209:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688192 00000100:00100000:3.0:1788638690.019274:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638690.019283:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183688192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638690.019315:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788638690.019382:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183688192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638690.019389:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638690.019432:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183688192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638690.020393:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638690.336010:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638690.530021:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638690.530043:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183688320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638690.530125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638690.530190:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688320 00000100:00100000:1.0:1788638690.530198:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688320 00000100:00100000:1.0:1788638690.530253:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638690.530261:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183688320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638690.530297:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638690.530363:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183688320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638690.530370:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788638690.530390:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638690.530425:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183688320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638690.530828:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183688448:0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.530864:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638690.530945:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688448 00000100:00100000:1.0:1788638690.530950:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688448 00000100:00100000:1.0:1788638690.530988:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788638690.530995:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183688448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638690.535160:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183688448:12345-0@lo:400:kworker.0 Request processed in 4154us (4283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638690.535174:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788638690.538384:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183688448:0@lo:400:kworker.0 00000100:00100000:1.0:1788638690.538552:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183688704:0@lo:400:kworker.0 00000100:00100000:1.0:1788638690.538607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638690.538665:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638690.538670:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183688832:0@lo:400:kworker.0 00000100:00100000:1.0:1788638690.538690:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638690.538834:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183688576:0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.538861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638690.538895:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688704 00000100:00100000:0.0:1788638690.538901:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688704 00000100:00100000:0.0:1788638690.538953:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688832 00000100:00100000:0.0:1788638690.538956:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688832 00000100:00100000:0.0:1788638690.538979:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688576 00000100:00100000:0.0:1788638690.538982:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688576 00000100:00100000:0.0:1788638690.538998:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638690.539005:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183688704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.539052:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183688704:12345-0@lo:400:kworker.0 Request processed in 47us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638690.539070:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638690.539088:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788638690.539093:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183688832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.539119:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183688832:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638690.539124:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788638690.539134:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788638690.539140:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183688576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.539167:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183688576:12345-0@lo:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638690.539172:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788638690.539194:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638690.539215:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183688576:0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.539238:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183688832:0@lo:400:kworker.0 00000100:00100000:0.0:1788638690.539246:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183688704:0@lo:400:kworker.0 00010000:00010000:2.0:1788638691.361604:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638692.387934:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638693.409515:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638694.147015:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638694.147042:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638694.147063:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638694.147069:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269184 00000100:00100000:2.0:1788638694.147080:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638694.147081:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269184 00000100:00100000:2.0:1788638694.147100:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269440 00000100:00100000:2.0:1788638694.147106:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269440 00000100:00100000:0.0:1788638694.147138:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 127 00000100:00100000:0.0:1788638694.147150:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174269184:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638694.147166:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:2.0:1788638694.147176:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174269440:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638694.147221:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174269184:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638694.147228:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 127 00000100:00100000:2.0:1788638694.147335:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174269440:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 160us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638694.147343:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:2.0:1788638694.147371:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269312 00000100:00100000:2.0:1788638694.147374:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269312 00000100:00100000:2.0:1788638694.148324:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269568 00000100:00100000:2.0:1788638694.148331:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269568 00000100:00080000:3.0:1788638694.148691:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788638694.148696:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638694.151606:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:0.0:1788638694.151653:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174269312:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638694.151766:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174269312:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 117us (4696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638694.151775:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:0.0:1788638694.151824:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:0.0:1788638694.151832:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174269568:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638694.151866:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174269568:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 35us (4784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638694.151872:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00010000:00010000:3.0:1788638694.435679:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638694.750775:0:17341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:04:53 (1788638693) 00000100:00100000:3.0:1788638695.136049:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638695.136115:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638695.136411:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183688960 00000100:00100000:1.0:1788638695.136434:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183688960 00000100:00100000:1.0:1788638695.136490:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638695.136499:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183688960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638695.136534:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788638695.136579:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183688960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638695.136586:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788638695.136665:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638695.136698:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183688960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788638695.458046:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638695.521821:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788638695.521830:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638695.521865:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788638695.521883:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788638695.649441:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638695.649468:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638695.649553:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638695.649607:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689088 00000100:00100000:3.0:1788638695.649618:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689088 00000100:00080000:1.0:1788638695.649662:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638695.649696:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788638695.649710:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183689088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638695.649762:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638695.649843:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183689088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638695.649850:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788638695.649932:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638695.654208:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183689600:0@lo:400:kworker.0 00000100:00100000:0.0:1788638695.654280:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638695.654331:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638695.654339:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183689472:0@lo:400:kworker.0 00000100:00100000:3.0:1788638695.654358:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183689344:0@lo:400:kworker.0 00000100:00100000:0.0:1788638695.654368:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638695.654402:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638695.654433:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638695.654439:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183689216:0@lo:400:kworker.0 00000100:00100000:3.0:1788638695.654471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638695.654524:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689216 00000100:00100000:3.0:1788638695.654530:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689216 00000100:00100000:3.0:1788638695.654586:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788638695.654596:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3294:x1875523183689216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638695.654657:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3294:x1875523183689216:12345-0@lo:400:kworker.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638695.654664:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788638695.654707:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183689216:0@lo:400:kworker.0 00000100:00100000:0.0:1788638695.656080:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689600 00000100:00100000:0.0:1788638695.656094:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689600 00000100:00080000:2.0:1788638695.656160:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638695.656174:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689472 00000100:00100000:0.0:1788638695.656179:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689472 00000100:00100000:0.0:1788638695.656203:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689344 00000100:00100000:0.0:1788638695.656206:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689344 00000100:00080000:2.0:1788638695.656210:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638695.656229:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638695.656239:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183689600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638695.656353:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788638695.656358:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183689600:12345-0@lo:400:kworker.0 Request processed in 119us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638695.656369:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183689472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638695.656370:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638695.656411:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788638695.656416:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183689472:12345-0@lo:400:kworker.0 Request processed in 51us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638695.656424:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183689344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638695.656428:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788638695.656471:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183689344:12345-0@lo:400:kworker.0 Request processed in 50us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638695.656478:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788638695.656501:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183689344:0@lo:400:kworker.0 00000100:00100000:2.0:1788638695.657642:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183689472:0@lo:400:kworker.0 00000100:00100000:2.0:1788638695.657657:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183689600:0@lo:400:kworker.0 00010000:00010000:1.0:1788638696.480237:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638697.505562:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638698.528162:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638699.285006:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638699.285060:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638699.285370:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269824 00000100:00100000:3.0:1788638699.285388:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269824 00000100:00100000:3.0:1788638699.285481:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638699.285500:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174269824:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638699.285581:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+12:2366:x1875523174269824:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 91us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638699.285588:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00080000:2.0:1788638699.285864:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638699.285981:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269696 00000100:00100000:1.0:1788638699.285986:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269696 00000100:00100000:1.0:1788638699.286035:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 129 00000100:00100000:1.0:1788638699.286041:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174269696:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638699.286082:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174269696:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 42us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638699.286095:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 129 00000100:00100000:0.0:1788638699.290262:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638699.290310:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638699.290450:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174270080 00000100:00100000:2.0:1788638699.290461:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174270080 00000100:00100000:2.0:1788638699.290538:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:2.0:1788638699.290548:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2367:x1875523174270080:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638699.290617:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2367:x1875523174270080:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638699.290625:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:3.0:1788638699.290884:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174269952 00000100:00100000:3.0:1788638699.290889:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174269952 00000100:00100000:3.0:1788638699.290929:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:3.0:1788638699.290937:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+5:2363:x1875523174269952:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:3.0:1788638699.290961:0:15079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bbd8 00000100:00080000:3.0:1788638699.290970:0:15079:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638699.291004:0:15079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788638699.291222:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+2:2363:x1875523174269952:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 284us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638699.291229:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00010000:00010000:1.0:1788638699.291526:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638699.291536:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638699.291540:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788638699.552016:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638699.890701:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638699.890879:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174270336 00000100:00100000:3.0:1788638699.890892:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174270336 00000100:00100000:3.0:1788638699.890973:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638699.890986:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+12:15316:x1875523174270336:12345-192.168.203.34@tcp:35:umount.0 00000001:00080000:3.0:1788638699.892534:0:14399:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788638699.892706:0:14399:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1788638699.892934:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+15:15316:x1875523174270336:12345-192.168.203.34@tcp:35:umount.0 Request processed in 1944us (2242us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788638699.892946:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000020:00080000:3.0:1788638699.892953:0:14399:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788638699.905557:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638699.905621:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638699.905668:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638699.905846:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174270464 00000100:00100000:1.0:1788638699.905859:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174270464 00000100:00100000:1.0:1788638699.905921:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174270720 00000100:00100000:1.0:1788638699.905924:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174270720 00000100:00100000:1.0:1788638699.905935:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174270592 00000100:00100000:1.0:1788638699.905937:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174270592 00000100:00100000:1.0:1788638699.905953:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:1.0:1788638699.905963:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+15:2367:x1875523174270464:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638699.905999:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638699.906022:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2bbbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b8 expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638699.906042:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638699.906108:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+14:2367:x1875523174270464:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 146us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638699.906116:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:1.0:1788638699.906136:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:1.0:1788638699.906143:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2367:x1875523174270720:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638699.906151:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638699.906160:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2bc64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435283 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638699.906169:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638699.906186:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:2367:x1875523174270720:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 44us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638699.906193:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:1.0:1788638699.906238:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:1.0:1788638699.906245:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:2367:x1875523174270592:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638699.906252:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638699.906261:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5569e00/0xa0b1f1e3b4b2bbc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e2 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638699.906280:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638699.906297:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:2367:x1875523174270592:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 54us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638699.906311:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:2.0:1788638699.907912:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638699.908009:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174271616 00000100:00100000:3.0:1788638699.908018:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174271616 00000100:00100000:3.0:1788638699.908087:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:3.0:1788638699.908097:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+15:2363:x1875523174271616:12345-192.168.203.34@tcp:39:umount.0 00000020:00000080:3.0:1788638699.908136:0:16245:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bbd1 00000020:00010000:3.0:1788638699.908155:0:16245:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73b576a000: total 0 00000100:00080000:3.0:1788638699.908160:0:16245:0:(import.c:65:import_set_state_nolock()) ffff9c73b576f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638699.908187:0:16245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1788638699.908651:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+14:2363:x1875523174271616:12345-192.168.203.34@tcp:39:umount.0 Request processed in 554us (748us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788638699.908660:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 55 00000020:00010000:0.0:1788638699.909140:0:15767:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73b576a000: total 0 00010000:00010000:0.0:1788638699.909145:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638699.909197:0:15767:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73b576a000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788638699.909249:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:0.0:1788638699.909253:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788638699.909271:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568400/0xa0b1f1e3b4b2be55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435316 expref: 13 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909301:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:0.0:1788638699.909304:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788638699.909308:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c9 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909324:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638699.909343:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638699.909349:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909365:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638699.909368:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638699.909371:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352f3 expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909391:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:0.0:1788638699.909394:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638699.909397:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2bc9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435291 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909528:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638699.909531:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638699.909536:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143529f expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909549:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c73a62bf500) 00010000:00010000:0.0:1788638699.909552:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638699.909555:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143528a expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638699.909568:0:15767:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73b576a000, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788638699.909580:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638699.909582:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638699.909584:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638700.256248:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638700.256308:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183689728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638700.256402:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638700.256579:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689728 00000100:00100000:1.0:1788638700.256590:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689728 00000100:00100000:1.0:1788638700.256679:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788638700.256691:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183689728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638700.256737:0:15080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788638700.256822:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183689728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638700.256830:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638700.256980:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183689728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638700.257048:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638700.577230:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638700.768063:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638700.768095:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183689856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638700.768348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638700.768483:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689856 00000100:00100000:1.0:1788638700.768494:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689856 00000100:00100000:1.0:1788638700.768567:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638700.768579:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183689856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638700.768639:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638700.768685:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183689984:0@lo:400:kworker.0 00000100:00100000:1.0:1788638700.768702:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183689856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638700.768709:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638700.768724:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638700.768744:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183690112:0@lo:400:kworker.0 00000100:00100000:1.0:1788638700.768775:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788638700.769028:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638700.769055:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183689984 00000100:00100000:2.0:1788638700.769059:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183689984 00000100:00100000:2.0:1788638700.769094:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788638700.769132:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183689984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769174:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183689984:12345-0@lo:400:kworker.0 Request processed in 56us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638700.769181:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788638700.769231:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183690368:0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638700.769290:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638700.769296:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183690240:0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769319:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638700.769350:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690112 00000100:00100000:2.0:1788638700.769354:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690112 00000100:00100000:2.0:1788638700.769382:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690368 00000100:00100000:2.0:1788638700.769385:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690368 00000100:00100000:2.0:1788638700.769414:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690240 00000100:00100000:2.0:1788638700.769417:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690240 00000100:00100000:2.0:1788638700.769432:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638700.769438:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183690112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769475:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183690112:12345-0@lo:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638700.769482:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638700.769494:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788638700.769500:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183690368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769527:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183690368:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638700.769533:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788638700.769542:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788638700.769547:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183690240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769581:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183690240:12345-0@lo:400:kworker.0 Request processed in 34us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638700.769588:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788638700.769606:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638700.769626:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183690240:0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769638:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183690368:0@lo:400:kworker.0 00000100:00100000:2.0:1788638700.769687:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183690112:0@lo:400:kworker.0 00000100:00100000:3.0:1788638700.773375:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183689856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638700.773673:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183689984:0@lo:400:kworker.0 00010000:00010000:3.0:1788638701.601711:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638701.904853:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638701.904888:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638701.904914:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638701.905072:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174271744 00000100:00100000:3.0:1788638701.905081:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174271744 00000100:00100000:3.0:1788638701.905122:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272000 00000100:00100000:3.0:1788638701.905124:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272000 00000100:00100000:3.0:1788638701.905134:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174271872 00000100:00100000:3.0:1788638701.905136:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174271872 00000100:00100000:3.0:1788638701.905149:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638701.905158:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:2366:x1875523174271744:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638701.905186:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638701.905203:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5568a00/0xa0b1f1e3b4b2bbf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143521a expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638701.905230:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638701.905296:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:2366:x1875523174271744:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 139us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638701.905303:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638701.905319:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638701.905324:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:2366:x1875523174272000:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638701.905342:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638701.905352:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5569800/0xa0b1f1e3b4b2bc5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143527c expref: 10 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638701.905361:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638701.905376:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+9:2366:x1875523174272000:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 53us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638701.905382:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638701.905392:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638701.905397:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:2366:x1875523174271872:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638701.905406:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638701.905413:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2bbfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435244 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638701.905421:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638701.905433:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+7:2366:x1875523174271872:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 36us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638701.905444:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638701.913409:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638701.913567:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272256 00000100:00100000:2.0:1788638701.913576:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272256 00000100:00100000:2.0:1788638701.913645:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:2.0:1788638701.913654:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:2363:x1875523174272256:12345-192.168.203.34@tcp:39:umount.0 00000020:00000080:2.0:1788638701.913689:0:16245:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bc09 00000020:00010000:2.0:1788638701.913696:0:16245:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73b576b800: total 0 00000100:00080000:2.0:1788638701.913701:0:16245:0:(import.c:65:import_set_state_nolock()) ffff9c7398b89800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638701.913728:0:16245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788638701.913937:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+5:2363:x1875523174272256:12345-192.168.203.34@tcp:39:umount.0 Request processed in 284us (536us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788638701.913945:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00000020:00010000:1.0:1788638701.914201:0:15767:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73b576b800: total 0 00010000:00010000:1.0:1788638701.914307:0:15767:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73b576b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788638701.914452:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:1.0:1788638701.914456:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788638701.914464:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352a6 expref: 4 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638701.914503:0:15767:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73b576b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788638701.914514:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638701.914516:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638701.914518:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788638701.914559:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638701.961890:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638701.962026:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272512 00000100:00100000:3.0:1788638701.962036:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272512 00000100:00100000:3.0:1788638701.962205:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:3.0:1788638701.962223:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+7:2363:x1875523174272512:12345-192.168.203.34@tcp:251:umount.0 00000020:00000080:3.0:1788638701.962276:0:14387:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bbae 00000020:00010000:3.0:1788638701.962283:0:14387:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73b576b000: total 0 00000100:00080000:3.0:1788638701.962287:0:14387:0:(import.c:65:import_set_state_nolock()) ffff9c73b576e800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788638701.962474:0:14383:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73b576b000: total 0 00010000:00010000:1.0:1788638701.962517:0:14383:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73b576b000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788638701.962549:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5569c00/0xa0b1f1e3b4b2bbb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b1 expref: 3 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638701.962565:0:14383:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73b576b000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788638701.962577:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638701.962580:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638701.962582:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638701.962859:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+1:2363:x1875523174272512:12345-192.168.203.34@tcp:251:umount.0 Request processed in 637us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638701.962868:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 131 00000020:00000080:3.0:1788638701.962878:0:14387:0:(genops.c:885:class_export_put()) final put ffff9c73b576b000/f4ea1363-ddd7-45b0-8012-313d4f61213a 00000020:00000080:0.0:1788638701.962938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b576b000/f4ea1363-ddd7-45b0-8012-313d4f61213a for MGS 00000020:00000080:0.0:1788638701.962979:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b576e800 for MGS 00010000:00010000:1.0:1788638702.624052:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788638702.902957:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00000001:00080000:0.0:1788638702.902981:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788638702.902990:0:5864:0:(genops.c:885:class_export_put()) final put ffff9c73b576b800/6181e191-5f1a-46ec-b515-69664fc84af5 00000001:00100000:0.0:1788638702.903006:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00000001:00080000:0.0:1788638702.903016:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788638702.903026:0:5864:0:(genops.c:885:class_export_put()) final put ffff9c73b576a000/0a963600-85ae-4d04-99fd-4389bf419479 00000020:00000080:0.0:1788638702.903038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b576b800/6181e191-5f1a-46ec-b515-69664fc84af5 for lustre-MDT0000 00000020:00000080:0.0:1788638702.903092:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b576a000/0a963600-85ae-4d04-99fd-4389bf419479 for lustre-MDT0000 00000020:00000080:0.0:1788638702.903119:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c7398b89800 for lustre-MDT0000 00000020:00000080:0.0:1788638702.903124:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b576f000 for lustre-MDT0000 00000001:00100000:0.0:1788638703.372378:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00000020:00000080:0.0:1788638703.372387:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73acdc0000/0a963600-85ae-4d04-99fd-4389bf419479 00000020:00000080:3.0:1788638703.372722:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc0000/0a963600-85ae-4d04-99fd-4389bf419479 for lustre-OST0000 00000020:00000080:3.0:1788638703.372949:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73acdc4000 for lustre-OST0000 00010000:00010000:1.0:1788638703.648367:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788638703.781777:0:17540:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788638703.801275:0:17540:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788638703.801328:0:17540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638703.801343:0:17540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638703.801352:0:17540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638703.801359:0:17540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638703.801419:0:17540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788638703.801424:0:17540:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788638703.801451:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788638703.801456:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788638703.801462:0:17540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788638703.801486:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73bf66b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788638703.801580:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183690496:0@lo:39:umount.0 00000100:00100000:3.0:1788638703.801640:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638703.801928:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690496 00000100:00100000:2.0:1788638703.801935:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690496 00000100:00100000:2.0:1788638703.801990:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788638703.801999:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875523183690496:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788638703.802028:0:14396:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b90e 00000100:00080000:2.0:1788638703.802035:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9c7398782000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788638703.802533:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638703.802542:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.802551:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6800 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638703.802555:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.802565:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638703.802573:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638703.802596:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788638703.802599:0:14383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788638703.802602:0:14383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788638703.802626:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.802632:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788638703.802673:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183690624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638703.802711:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638703.802775:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690624 00000100:00100000:3.0:1788638703.802779:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690624 00000100:00100000:3.0:1788638703.802843:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638703.802851:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183690624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638703.802860:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638703.802874:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2b8e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8dd expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.802888:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638703.802996:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.803004:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.803015:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638703.803017:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638703.803134:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638703.803266:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3290:x1875523183690496:12345-0@lo:39:umount.0 Request processed in 1267us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638703.803281:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:2.0:1788638703.803292:0:14396:0:(genops.c:885:class_export_put()) final put ffff9c7398780000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788638703.803316:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7398780000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788638703.803355:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c7398782000 for lustre-MDT0000 00010000:00010000:1.0:1788638703.803452:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788638703.803570:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf66b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788638703.803586:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183690496:0@lo:39:umount.0 00000100:00080000:1.0:1788638703.803638:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638703.803642:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788638703.803646:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788638703.804764:0:17540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.804777:0:17540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.804989:0:17540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.804998:0:17540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638703.805110:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:3291:x1875523183690624:12345-0@lo:103:ldlm_bl.0 Request processed in 2257us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638703.805124:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788638703.805278:0:17540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638703.805286:0:17540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.805294:0:17540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.805301:0:17540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.805307:0:17540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638703.805368:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183690624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638703.805420:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638703.805427:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805435:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638703.805439:0:15767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805448:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638703.805455:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638703.805461:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638703.805463:0:15767:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788638703.805489:0:15767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805495:0:15767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638703.805523:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805541:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805554:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638703.805557:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805563:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467800 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638703.805566:0:15767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805572:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638703.805578:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638703.805583:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638703.805586:0:15767:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788638703.805595:0:15767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805601:0:15767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638703.805614:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805621:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638703.805622:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638703.805624:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638703.805634:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638703.805645:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183690880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638703.805691:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638703.805727:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690880 00000100:00100000:2.0:1788638703.805732:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690880 00000100:00100000:2.0:1788638703.805769:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638703.805777:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:3294:x1875523183690880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638703.805819:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638703.805832:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7600/0xa0b1f1e3b4b2bae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2badc expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.805846:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638703.805871:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:3294:x1875523183690880:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638703.805877:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638703.805900:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183690880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638703.806048:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638703.806056:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183690752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638703.806082:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638703.806290:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183690752 00000100:00100000:3.0:1788638703.806295:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183690752 00000100:00100000:3.0:1788638703.806327:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638703.806333:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:3291:x1875523183690752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638703.806341:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638703.806349:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031000/0xa0b1f1e3b4b2b84a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b843 expref: 17 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.806358:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638703.806393:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3291:x1875523183690752:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638703.806399:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638703.806500:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183690752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638703.806589:0:17540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638703.806595:0:17540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638703.806606:0:17540:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788638703.806614:0:17540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.806621:0:17540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.806628:0:17540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.806633:0:17540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.806670:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638703.806675:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.806681:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638703.806685:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.806692:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638703.806698:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638703.806709:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788638703.806711:0:14383:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788638703.806726:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.806731:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638703.806754:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.806762:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638703.806764:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638703.806766:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638703.806864:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638703.806879:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183691008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638703.806908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638703.807159:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183691008 00000100:00100000:2.0:1788638703.807164:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183691008 00000100:00100000:2.0:1788638703.807191:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638703.807197:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3293:x1875523183691008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638703.807215:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638703.807226:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2bc56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc4f expref: 16 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638703.807246:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638703.807277:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:3293:x1875523183691008:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638703.807283:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638703.807307:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183691008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638703.807511:0:17540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638703.807517:0:17540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638703.807527:0:17540:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788638703.807534:0:17540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.807541:0:17540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.807548:0:17540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638703.807554:0:17540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.807579:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638703.807584:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.807590:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030800 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638703.807593:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.807601:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638703.807608:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638703.807613:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638703.807620:0:14384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1788638703.807633:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.807639:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638703.807661:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.807669:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638703.807671:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638703.807673:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638703.807709:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183691136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638703.807733:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638703.807999:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183691136 00000100:00100000:3.0:1788638703.808004:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183691136 00000100:00100000:3.0:1788638703.808099:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638703.808106:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:3291:x1875523183691136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638703.808114:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638703.808123:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2b83c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b835 expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638703.808134:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638703.808165:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:3291:x1875523183691136:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638703.808171:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638703.808280:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183691136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638703.808383:0:17540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638703.808388:0:17540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638703.808399:0:17540:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788638703.808403:0:17540:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788638703.808406:0:17540:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788638703.808432:0:17540:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788638703.808436:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788638703.808441:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638703.808447:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788638703.808451:0:17540:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c73acdc6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788638703.808463:0:17540:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c73bf0e8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788638703.808468:0:17540:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c73880ab380) has exports, disconnecting them 00000020:00080000:1.0:1788638703.808472:0:17540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c73acdc6000), last request at 1788638700 00000020:00000080:1.0:1788638703.808478:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bace 00000100:00080000:1.0:1788638703.808494:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc7800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788638703.808517:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788638703.808594:0:17540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73acdc6000): rc 0 00000020:00000080:1.0:1788638703.808597:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73acdc6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788638703.808612:0:17540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c73bf0e8000), last request at 1788638700 00000020:00000080:1.0:1788638703.808615:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b993 00000100:00080000:1.0:1788638703.808620:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0ec800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788638703.808643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788638703.808681:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73acdc7800 for lustre-MDT0000 00010000:00010000:2.0:1788638703.808731:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788638703.808870:0:17540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73bf0e8000): rc 0 00000020:00000080:1.0:1788638703.808872:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73bf0e8000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788638703.808885:0:17540:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd4884687ae0 00000100:00080000:1.0:1788638703.808903:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788638703.808906:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000020:00000080:0.0:1788638703.808995:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf0e8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00080000:1.0:1788638703.809017:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788638703.809082:0:17540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788638703.809096:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788638703.809107:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788638703.809109:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788638703.809116:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788638703.809167:0:17540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788638703.809174:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788638703.809200:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c73880ab380) has no exports 00000020:00000080:0.0:1788638703.809679:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bf0ec800 for lustre-MDT0000 00010000:00010000:3.0:1788638703.809740:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638703.809778:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183691264:0@lo:9:umount.0 00000100:00100000:2.0:1788638703.810165:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638703.810318:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183691392:0@lo:9:umount.0 00000100:00100000:2.0:1788638703.810343:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638703.810472:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183691264 00000100:00100000:0.0:1788638703.810478:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183691264 00000100:00100000:0.0:1788638703.810532:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183691392 00000100:00100000:0.0:1788638703.810536:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183691392 00000100:00100000:0.0:1788638703.810555:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638703.810562:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bb550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1875523183691264:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788638703.810582:0:16638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b9af 00000100:00080000:0.0:1788638703.810588:0:16638:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788638703.810614:0:16638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00080000:2.0:1788638703.810893:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638703.810898:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638703.810912:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638703.810920:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875523183691392:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788638703.810934:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2baea 00000100:00080000:2.0:1788638703.810940:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c7283018800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638703.810962:0:15078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788638703.811360:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3290:x1875523183691392:12345-0@lo:9:umount.0 Request processed in 441us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638703.811368:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788638703.811399:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788638703.811427:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788638703.811437:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788638703.811440:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788638703.811443:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183691392:0@lo:9:umount.0 00010000:00010000:2.0:1788638703.811468:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638703.811632:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bb550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3290:x1875523183691264:12345-0@lo:9:umount.0 Request processed in 1069us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638703.811640:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788638703.811963:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788638703.811978:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788638703.811979:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788638703.811982:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183691264:0@lo:9:umount.0 00000020:00080000:0.0:1788638703.820631:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c73880ab380) has no exports 00000020:00000080:0.0:1788638703.866577:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b890 00000020:00000080:0.0:1788638703.866594:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73882e6000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788638703.866654:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788638703.866953:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638703.866964:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788638703.866969:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c73bce38000) has no exports 00000020:00000080:1.0:1788638703.867314:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b889 00000020:00000080:1.0:1788638703.867332:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c738666d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788638703.867756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73882e6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788638703.868118:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c738666d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788638703.868184:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638703.868193:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788638703.868273:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73882e1000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788638703.868277:0:17540:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73882e1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788638703.868285:0:17540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788638703.868622:0:17540:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7384d0b120 - data ffff9c73a7b65798/ffff9c72818f6000 00000020:01000000:1.0:1788638703.868746:0:17540:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73909331e0 - data ffff9c73bf927af8/ffff9c73ae0eac00 00000001:00000004:1.0:1788638703.880153:0:17540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1788638703.966648:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788638703.966655:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:0.0:1788638703.966676:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788638703.966678:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788638703.967754:0:14417:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788638703.967760:0:14417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1788638703.967777:0:14417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788638703.968863:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788638703.968868:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788638703.968882:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788638703.968884:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788638703.969252:0:14419:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788638703.969262:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788638703.969269:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788638704.048130:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b858 00000020:00000080:0.0:1788638704.048142:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73a0466000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788638704.048976:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b86d 00000020:00000080:0.0:1788638704.048983:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73a0b22800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788638704.048988:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788638704.048994:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.049002:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788638704.049006:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c73880a8000) has no exports 00000004:01000000:0.0:1788638704.049164:0:17540:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788638704.049173:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b8ba 00000020:00000080:0.0:1788638704.049177:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73ad477000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788638704.049181:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788638704.049185:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.049189:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788638704.049191:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c7385323380) has no exports 00000020:00000080:0.0:1788638704.049197:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b8b3 00000020:00000080:0.0:1788638704.049200:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73bce5f800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788638704.049533:0:17540:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788638704.049538:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788638704.049542:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788638704.049547:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788638704.049550:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788638704.049577:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.049583:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788638704.049589:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b8a5 00000020:00000080:0.0:1788638704.049595:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788638704.049599:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788638704.049602:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.049604:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788638704.049606:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9c73853219c0) has no exports 00000020:00000080:0.0:1788638704.049610:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b89e 00000020:00000080:0.0:1788638704.049623:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73bce5c000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788638704.049969:0:17540:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788638704.049972:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788638704.049975:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788638704.049979:0:17540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788638704.049980:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788638704.050003:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.050008:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788638704.050033:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.050037:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788638704.050061:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b874 00000020:00000080:0.0:1788638704.050066:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73a0b21800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788638704.050069:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788638704.050073:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.050077:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788638704.050079:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c73880acd40) has no exports 00000020:00000080:0.0:1788638704.050094:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.050098:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788638704.050101:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b87b 00000020:00000080:0.0:1788638704.050104:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73a0b27800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788638704.050111:0:17540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73908d2000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788638704.050114:0:17540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73908d2000 3 00000020:01000004:0.0:1788638704.050117:0:17540:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73908d2000 from lustre-MDT0000 00000020:00000080:0.0:1788638704.050134:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.050138:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788638704.050140:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73a0460000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788638704.050143:0:17540:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0460000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788638704.050150:0:17540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788638704.050206:0:17540:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788638704.050211:0:17540:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788638704.050213:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788638704.050216:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.050219:0:17540:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788638704.050231:0:17540:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c73b7e9f000 d97ff07e-b3b5-4ef8-bed3-2a6960653930 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788638704.050250:0:17540:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c7385320000) has exports, disconnecting them 00000020:00080000:0.0:1788638704.050254:0:17540:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c73b7e9f000), last request at 1788638622 00000020:00000080:0.0:1788638704.050269:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b820 00000020:00010000:0.0:1788638704.050273:0:17540:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73b7e9f000: total 8 00000100:00080000:0.0:1788638704.050277:0:17540:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788638704.050296:0:17540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73b7e9f000): rc 0 00000020:00080000:0.0:1788638704.050301:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c7385320000) has no exports 00000020:00010000:0.0:1788638704.050314:0:14384:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73b7e9f000: total 8 00010000:00010000:0.0:1788638704.050317:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638704.050340:0:14384:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73b7e9f000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788638704.050367:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b946 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b93f expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050387:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b94d expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050400:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2ba8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2ba88 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050411:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b827 expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050422:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030e00/0xa0b1f1e3b4b2bc48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc41 expref: 5 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050431:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b97e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b977 expref: 4 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050441:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5569600/0xa0b1f1e3b4b2bc3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc33 expref: 3 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050467:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2bab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bab2 expref: 2 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638704.050477:0:14384:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73b7e9f000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788638704.050489:0:14384:0:(genops.c:885:class_export_put()) final put ffff9c73b7e9f000/d97ff07e-b3b5-4ef8-bed3-2a6960653930 00010000:00010000:0.0:1788638704.050493:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638704.050495:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638704.050497:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638704.050557:0:14388:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c7387c68a00:14388] 1 exiting: rc = 0 00000020:00000080:2.0:1788638704.051494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0466000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788638704.051519:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0b22800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788638704.051524:0:36:0:(genops.c:885:class_export_put()) final put ffff9c73a0465800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788638704.051526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0465800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788638704.051530:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638704.051638:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad477000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788638704.051643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bce5f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788638704.051648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bce59800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788638704.051652:0:36:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788638704.051654:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788638704.051657:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638704.051684:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788638704.051688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bce5c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788638704.051692:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bce5f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788638704.051695:0:36:0:(genops.c:885:class_export_put()) final put ffff9c73bce5a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788638704.051697:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bce5a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788638704.051700:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638704.051744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0b21800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788638704.051748:0:36:0:(genops.c:885:class_export_put()) final put ffff9c73a0467000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788638704.051749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0467000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788638704.051753:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788638704.051858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a0b27800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788638704.051863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e9f000/d97ff07e-b3b5-4ef8-bed3-2a6960653930 for MGS 00000020:00000080:2.0:1788638704.051894:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b7e9f800 for MGS 00000100:00100000:0.0:1788638704.052151:0:14389:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c73983f3c00:14389] 2 exiting: rc = 0 00000100:00100000:3.0:1788638704.052569:0:14387:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c73916d9600:14387] 0 exiting: rc = 1 00000100:00100000:0.0:1788638704.052808:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052818:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052824:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052830:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052837:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052842:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052848:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052854:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052860:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052866:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052871:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052876:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052882:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052887:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052893:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052898:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052903:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052909:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052924:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052930:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052935:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052951:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052956:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052962:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052967:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052972:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052977:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052984:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052989:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.052995:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053003:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053008:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053013:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053223:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053232:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053247:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053253:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053258:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053263:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053268:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053273:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053278:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053282:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053287:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053293:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053298:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053303:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053307:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053312:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053316:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053321:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053327:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053331:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053336:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053341:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053347:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053424:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053432:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053438:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053443:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053449:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053455:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053460:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638704.053465:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788638704.054332:0:17540:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788638704.054336:0:17540:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788638704.055526:0:17540:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7384d0b240 - data ffff9c73bfa98bd0/ffff9c72818f7c00 00000020:01000000:0.0:1788638704.055647:0:17540:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73983cd0c0 - data ffff9c73a7ba5870/ffff9c73bf146400 00000020:00000080:0.0:1788638704.057744:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b804 00000020:00000080:0.0:1788638704.057753:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c7281394000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788638704.057775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7281394000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788638704.057805:0:17540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73908d2000 from MGS, refs=2 00000020:01000004:0.0:1788638704.057808:0:17540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73908d2000 2 00000020:01000004:0.0:1788638704.057812:0:17540:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73908d2000 from MGS 00000020:00000080:0.0:1788638704.057834:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638704.057841:0:17540:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788638704.057843:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c7281390800/MGS 00000020:00000080:0.0:1788638704.057845:0:17540:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7281390800/MGS for MGS 00000020:01000000:0.0:1788638704.057852:0:17540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788638704.057907:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788638704.057911:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638704.058573:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788638704.058582:0:17540:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c73bf66e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788638704.058588:0:17540:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9c7385324d40) has exports, disconnecting them 00000020:00080000:0.0:1788638704.058593:0:17540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c73bf66e000), last request at 1788638623 00000020:00000080:0.0:1788638704.058597:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b8f2 00000020:00080000:0.0:1788638704.058609:0:17540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73bf66e000): rc 0 00000020:00000080:0.0:1788638704.058613:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73bf66e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788638704.059462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf66e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788638704.070906:0:17540:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788638704.070923:0:17540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638704.070938:0:17540:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788638704.070944:0:17540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788638704.071130:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638704.071139:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788638704.071146:0:17540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73908d2000 1 00000020:00000080:2.0:1788638704.071152:0:17540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b7f6 00000020:00000080:2.0:1788638704.071161:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c7281390000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788638704.071166:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788638704.071171:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638704.071175:0:17540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788638704.071178:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c73bce399c0) has no exports 00000020:00000080:3.0:1788638704.071622:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bf66b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788638704.071630:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7383649000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788638704.071634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7383649000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788638704.071645:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788638704.071698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7281390000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788638704.106251:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638704.106265:0:17540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788638704.106270:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c73908d4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788638704.106274:0:17540:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73908d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788638704.106281:0:17540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788638704.106421:0:17540:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c73908d4000 00000020:01000000:2.0:1788638704.106440:0:17540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788638704.106444:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638704.106448:0:17540:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788638704.106452:0:17540:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c7387d48000) has no exports 00000100:00100000:2.0:1788638704.106510:0:16245:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c73bf6ed400:16245] 3 exiting: rc = 0 00000100:00100000:2.0:1788638704.106612:0:14396:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c73ad466c00:14396] 1 exiting: rc = 0 00000100:00100000:3.0:1788638704.110460:0:14397:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c73ad467000:14397] 2 exiting: rc = 0 00000100:00100000:3.0:1788638704.110604:0:14395:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c73ad466800:14395] 0 exiting: rc = 1 00000100:00100000:2.0:1788638704.111400:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111408:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111415:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111421:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111428:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111434:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111444:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111451:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111457:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111462:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111481:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111486:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111494:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111499:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111504:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111512:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111518:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111523:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111529:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111535:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111540:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111546:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111550:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111555:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111561:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111566:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111571:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111580:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111587:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111595:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111603:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111610:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111617:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111624:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111629:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111634:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111640:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111646:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111651:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111657:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111663:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111669:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111675:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111680:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111686:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111701:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111708:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111713:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111718:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111723:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111729:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111734:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111754:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111761:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111766:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111773:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111778:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111799:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111806:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111811:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111820:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111825:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111830:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.111836:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.117152:0:14398:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c73ad466000:14398] 0 exiting: rc = 1 00000100:00100000:3.0:1788638704.119897:0:14399:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c73ad467600:14399] 1 exiting: rc = 0 00000100:00100000:2.0:1788638704.120050:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120058:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120065:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120070:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120074:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120079:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120084:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120088:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120093:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120099:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120104:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120109:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120115:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120119:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120124:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120148:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120153:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120159:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120165:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120170:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120176:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120182:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120187:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120193:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120208:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120213:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120218:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120223:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120228:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120241:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120247:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120252:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120257:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120261:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120266:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120270:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120274:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120279:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120284:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120288:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120292:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120297:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120302:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120306:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120311:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120316:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120320:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120326:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120331:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120337:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120350:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120355:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120529:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120540:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120545:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120550:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120555:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120560:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120565:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120570:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120576:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120582:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120587:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.120592:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638704.121181:0:14400:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c73812e7c00:14400] 0 exiting: rc = 1 00000100:00100000:3.0:1788638704.121655:0:14401:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c73ad6e6a00:14401] 1 exiting: rc = 0 00000100:00100000:3.0:1788638704.121716:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121723:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121728:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121733:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121738:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121744:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121751:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121756:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121763:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121801:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121810:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121816:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121822:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121830:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121835:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121842:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121849:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121855:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121860:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121867:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121873:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121904:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121912:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121919:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121925:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121930:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121935:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121941:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121947:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121954:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121961:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121968:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121975:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.121996:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122004:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122009:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122014:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122032:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122038:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122044:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122049:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122055:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122061:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122067:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122074:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122094:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122103:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122108:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122113:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122119:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122125:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122131:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122136:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122141:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122146:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122152:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122164:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122184:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122191:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122209:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122216:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122222:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122228:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.122253:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638704.145966:0:14402:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c73982b0600:14402] 0 exiting: rc = 1 00000100:00100000:1.0:1788638704.146136:0:14403:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c73982b1600:14403] 1 exiting: rc = 0 00000100:00100000:2.0:1788638704.146507:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146515:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146520:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146527:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146532:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146537:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146542:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146547:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146552:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146556:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146561:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146565:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146570:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146575:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146580:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146585:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146590:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146595:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146602:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146609:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146613:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146630:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146635:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146640:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146646:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146651:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146655:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146661:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146667:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146671:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146676:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146680:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146685:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146689:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146695:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146700:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146705:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146709:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146714:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146720:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146724:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146729:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146734:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146738:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146743:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146748:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146753:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146758:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146764:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146768:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146772:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146777:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146808:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146814:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146819:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146824:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146837:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146842:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146847:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146853:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146857:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146862:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146866:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.146871:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147186:0:14404:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c738730d600:14404] 0 exiting: rc = 1 00000100:00100000:3.0:1788638704.147409:0:14405:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c73ad6e7a00:14405] 1 exiting: rc = 0 00000100:00100000:2.0:1788638704.147602:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147608:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147613:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147617:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147622:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147627:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147632:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147636:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147641:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147646:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147650:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147655:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147659:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147664:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147668:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147672:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147676:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147681:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147685:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147689:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147694:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147699:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147703:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147707:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147712:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147716:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147730:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147735:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147740:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147745:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147750:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147755:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147760:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147765:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147770:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147776:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147801:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147808:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147813:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147818:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147822:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147827:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147833:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147838:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147844:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147849:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147854:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147859:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147864:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147869:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147874:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147880:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147885:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147890:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147894:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147899:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147904:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147909:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147915:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147920:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147925:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147938:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147942:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.147947:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638704.148217:0:14406:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c738730d400:14406] 0 exiting: rc = 1 00000100:00100000:3.0:1788638704.148488:0:14407:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c738730c800:14407] 1 exiting: rc = 0 00000100:00100000:3.0:1788638704.148537:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148543:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148548:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148553:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148559:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148564:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148569:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148574:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148580:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148586:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148591:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148596:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148601:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148606:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148611:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148616:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148620:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148624:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148629:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148633:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148637:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148641:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148646:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148650:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148655:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148668:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148673:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148678:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148683:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148688:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148692:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148696:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148700:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148705:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148710:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148715:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148720:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148725:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148731:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148736:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148741:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148746:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148751:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148755:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148760:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148764:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148770:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148775:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148800:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148806:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148811:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148816:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148822:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148827:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148832:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148837:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148842:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148848:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148854:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148859:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148871:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148877:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148882:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.148888:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.149333:0:14409:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c7387d2c800:14409] 1 exiting: rc = 0 00000100:00100000:2.0:1788638704.150028:0:14410:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c7385231200:14410] 2 exiting: rc = 0 00000100:00100000:1.0:1788638704.150643:0:14408:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c7386796600:14408] 0 exiting: rc = 1 00000100:00100000:3.0:1788638704.150933:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150941:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150947:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150953:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150959:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150965:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150984:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.150994:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151001:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151008:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151014:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151030:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151036:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151042:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151047:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151055:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151060:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151066:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151071:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151077:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151081:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151087:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151093:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151099:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151104:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151110:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151115:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151121:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151126:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151134:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151169:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151176:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151181:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151187:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151192:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151207:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151215:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151221:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151227:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151231:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151244:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151250:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151254:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151259:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151264:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151270:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151276:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151281:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151287:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151291:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151296:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151300:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151306:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151311:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151343:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151351:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151355:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151371:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151377:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151383:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151390:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151395:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151401:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638704.151407:0:17540:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788638704.156032:0:17540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638704.156046:0:17540:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788638704.156052:0:17540:0:(genops.c:885:class_export_put()) final put ffff9c738364c800/MDS_uuid 00000020:00000080:2.0:1788638704.156056:0:17540:0:(genops.c:844:class_export_destroy()) destroying export ffff9c738364c800/MDS_uuid for MDS 00000020:01000000:2.0:1788638704.156062:0:17540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788638704.156184:0:17540:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788638704.676661:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638705.696008:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638705.889721:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183691520:0@lo:400:kworker.0 00000400:00000100:0.0:1788638705.889779:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523183691520 offset 0 length 224: 4 00000100:00100000:3.0:1788638705.890446:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183691776:0@lo:400:kworker.0 00000400:00000100:3.0:1788638705.890485:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183691776 offset 0 length 224: 4 00000100:00100000:2.0:1788638705.891081:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183691648:0@lo:400:kworker.0 00000400:00000100:2.0:1788638705.891106:0:3293:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183691648 offset 0 length 224: 4 00000001:00100000:2.0:1788638706.451346:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788638706.451355:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c728301b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788638706.451425:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c728301b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788638706.451577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c7283018800 for lustre-OST0001 00010000:00010000:0.0:1788638706.722576:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788638707.304266:0:17690:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788638707.322942:0:17690:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788638707.322985:0:17690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638707.323010:0:17690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638707.323016:0:17690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638707.323023:0:17690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638707.323040:0:17690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788638707.323045:0:17690:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788638707.323063:0:17690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638707.323086:0:17690:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c44380 x1875523183691648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638707.323109:0:17690:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788638707.323116:0:17690:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788638707.323142:0:17690:0:(import.c:65:import_set_state_nolock()) ffff9c73b4e1a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788638707.323384:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183691648:0@lo:400:kworker.0 00010000:00010000:3.0:1788638707.323469:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638707.323476:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638707.323484:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638707.323488:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638707.323497:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638707.323504:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638707.323518:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638707.323521:0:14383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788638707.323524:0:14383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788638707.323549:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638707.323557:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638707.323581:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638707.323588:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638707.323611:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638707.323613:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638707.323614:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638707.323639:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183691904:0@lo:39:umount.0 00000400:00000100:3.0:1788638707.323686:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183691904 offset 0 length 224: 4 00000100:00100000:0.0:1788638707.323936:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638707.323947:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183692032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638707.323984:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638707.324151:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183692032 00000100:00100000:3.0:1788638707.324158:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183692032 00000100:00100000:3.0:1788638707.324208:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788638707.324225:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3292:x1875523183692032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788638707.324231:0:14382:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788638707 with bad export cookie 11579302077237737504 00000100:00100000:2.0:1788638707.344978:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3292:x1875523183692032:12345-0@lo:103:ldlm_bl.0 Request processed in 20748us (20989us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788638707.344992:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788638707.345065:0:3292:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788638707.345071:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788638707.345075:0:3292:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788638707.359105:0:3292:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.134@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788638707.359110:0:3292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788638707.359120:0:3292:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c46680 x1875523183691520/t0(0) o400->MGC192.168.203.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788638721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638707.359134:0:3292:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c44e00 x1875523183692032/t0(0) o103->MGC192.168.203.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788638723 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788638707.359143:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788638707.359145:0:3292:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788638707.359147:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788638707.359150:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638707.359154:0:3292:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 385 00000100:00080000:3.0:1788638707.359162:0:3292:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import ffff9c738364a800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638707.361687:0:3292:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad6c0e00 x1875523183692160/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638707.361731:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183692160:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788638707.361779:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523183692160 offset 0 length 520: 4 00000100:00100000:2.0:1788638707.361872:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183691520:0@lo:400:kworker.0 00000100:00100000:2.0:1788638707.361904:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183692032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638707.745159:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788638708.472042:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788638708.472050:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73acdc6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788638708.472120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788638708.472288:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73acdc0800 for lustre-OST0000 00010000:00010000:0.0:1788638708.771093:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638709.792032:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638710.816293:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638711.009140:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788638711.009158:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788638711.009317:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638711.009336:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183692288:0@lo:400:kworker.0 00000400:00000100:0.0:1788638711.009386:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183692288 offset 0 length 224: 4 00010000:00010000:0.0:1788638711.840108:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638712.031909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788638712.031919:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788638712.032062:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638712.032081:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183692416:0@lo:400:kworker.0 00000400:00000100:3.0:1788638712.032138:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183692416 offset 0 length 224: 4 00010000:00010000:3.0:1788638712.865883:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638713.888045:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638714.911926:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638715.936268:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638716.964249:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638717.155997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788638717.156007:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788638717.156163:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638717.156183:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183692544:0@lo:400:kworker.0 00000400:00000100:2.0:1788638717.156237:0:3293:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183692544 offset 0 length 224: 4 00000100:00100000:2.0:1788638717.666593:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638707/real 1788638707] req@ffff9c73ad6c0e00 x1875523183692160/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788638717 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638717.666624:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73ad6c0e00 x1875523183692160/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788638717 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638717.666635:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638707/real 1788638707] req@ffff9c73ad30f800 x1875523183691904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788638717 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638717.666648:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73ad30f800 x1875523183691904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788638717 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788638717.666664:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638717.666745:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788638717.666749:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183692160:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788638717.666755:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b4e1a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788638717.666771:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183691904:0@lo:39:umount.0 00000100:00080000:1.0:1788638717.667154:0:17690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638717.667159:0:17690:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788638717.667165:0:17690:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788638717.670154:0:17690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670183:0:17690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670192:0:17690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670199:0:17690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670235:0:17690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638717.670257:0:17690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670266:0:17690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670273:0:17690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638717.670279:0:17690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788638717.670292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:1.0:1788638717.670293:0:17690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788638717.670299:0:17690:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00080000:3.0:1788638717.670300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788638717.670306:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638717.670314:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1788638717.670319:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788638717.670325:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import ffff9c738364a800 using connection 192.168.203.134@tcp/0@lo 00000020:01000004:1.0:1788638717.670326:0:17690:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788638717.670331:0:17690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788638717.670337:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638717.670343:0:17690:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788638717.670347:0:17690:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c73880a99c0) has no exports 00000100:00100000:3.0:1788638717.670357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c47480 x1875523183692672/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1788638717.670375:0:17690:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c73880a99c0) has no exports 00010000:00010000:2.0:1788638717.670528:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638717.670536:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670545:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638717.670549:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670566:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638717.670574:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638717.670580:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638717.670583:0:14383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788638717.670585:0:14383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788638717.670600:0:14383:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:2.0:1788638717.670603:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670611:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670626:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638717.670629:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670635:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638717.670638:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670645:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638717.670651:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638717.670668:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788638717.670671:0:14383:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788638717.670672:0:14383:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788638717.670678:0:14383:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:2.0:1788638717.670694:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670701:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638717.670711:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638717.670713:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638717.670715:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638717.670840:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183692672:0@lo:250:kworker.0 00000400:00000100:2.0:1788638717.671179:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523183692672 offset 0 length 520: 4 00000020:01000000:1.0:1788638717.671995:0:17690:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7398407900 - data ffff9c73bfb601b0/ffff9c73b54b9c00 00000020:01000000:1.0:1788638717.672108:0:17690:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7386722000 - data ffff9c73913741b0/ffff9c73b547d000 00010000:00010000:0.0:1788638717.672302:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788638717.687559:0:17690:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788638717.720979:0:17690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b962 00000020:00000080:2.0:1788638717.720988:0:17690:0:(genops.c:885:class_export_put()) final put ffff9c73acdc3000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788638717.721001:0:17690:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73b4524000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788638717.721005:0:17690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4524000 2 00000020:01000004:2.0:1788638717.721008:0:17690:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73b4524000 from lustre-OST0000 00000020:00000080:2.0:1788638717.721034:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638717.721043:0:17690:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788638717.721046:0:17690:0:(genops.c:885:class_export_put()) final put ffff9c73acdc4800/lustre-OST0000_UUID 00000020:00000080:2.0:1788638717.721049:0:17690:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788638717.721055:0:17690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788638717.721092:0:17690:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788638717.721097:0:17690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788638717.721100:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638717.721135:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788638717.721310:0:17690:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788638717.721328:0:17690:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c73ad475000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788638717.721334:0:17690:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c73ae394d40) has exports, disconnecting them 00000020:00080000:2.0:1788638717.721339:0:17690:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c73ad475000), last request at 1788638636 00000020:00000080:2.0:1788638717.721343:0:17690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b98c 00000020:00080000:2.0:1788638717.721356:0:17690:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73ad475000): rc 0 00000020:00000080:2.0:1788638717.721361:0:17690:0:(genops.c:885:class_export_put()) final put ffff9c73ad475000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788638717.721412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad475000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788638717.726867:0:17690:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788638717.726875:0:17690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788638717.726879:0:17690:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788638717.726885:0:17690:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788638717.727272:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638717.727281:0:17690:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788638717.727288:0:17690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4524000 1 00000020:00000080:3.0:1788638717.727295:0:17690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b931 00000020:00000080:3.0:1788638717.727303:0:17690:0:(genops.c:885:class_export_put()) final put ffff9c73bf66e800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788638717.728293:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b4e1a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788638717.728304:0:36:0:(genops.c:885:class_export_put()) final put ffff9c73ad472800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788638717.728307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad472800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788638717.728332:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788638717.729260:0:17690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788638717.729295:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638717.729303:0:17690:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788638717.729308:0:17690:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c7387d4cd40) has no exports 00000020:00000080:1.0:1788638717.729425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf66e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788638717.743969:0:17690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638717.743985:0:17690:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788638717.743991:0:17690:0:(genops.c:885:class_export_put()) final put ffff9c739b41a800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788638717.743995:0:17690:0:(genops.c:844:class_export_destroy()) destroying export ffff9c739b41a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788638717.744002:0:17690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788638717.744153:0:17690:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c73b4520000 00000020:02000400:1.0:1788638717.744198:0:17690:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788638717.985230:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638719.008024:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638720.032362:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788638720.071607:0:17845:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788638720.084938:0:17845:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788638720.085014:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638720.085030:0:17845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638720.085038:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638720.085046:0:17845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638720.085068:0:17845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788638720.085073:0:17845:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788638720.085094:0:17845:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638720.085105:0:17845:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c47800 x1875523183691776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638720.085123:0:17845:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73ad30ed80 x1875523183692288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638720.085158:0:17845:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73ad30d180 x1875523183692416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638728 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638720.085184:0:17845:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c47100 x1875523183692544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638733 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638720.085195:0:17845:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788638720.085202:0:17845:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788638720.085225:0:17845:0:(import.c:65:import_set_state_nolock()) ffff9c73b576a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788638720.085311:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638720.085319:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638720.085325:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638720.085330:0:15767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638720.085338:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638720.085345:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638720.085350:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638720.085352:0:15767:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788638720.085354:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788638720.085365:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:2.0:1788638720.085369:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638720.085375:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638720.085392:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638720.085394:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638720.085406:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638720.085425:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183692800:0@lo:39:umount.0 00000100:00100000:3.0:1788638720.085441:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183692288:0@lo:400:kworker.0 00000400:00000100:2.0:1788638720.085469:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183692800 offset 0 length 224: 4 00000100:00100000:0.0:1788638720.085818:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183692416:0@lo:400:kworker.0 00000100:00100000:0.0:1788638720.085826:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788638720.085848:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183692544:0@lo:400:kworker.0 00010000:00010000:2.0:1788638721.055986:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638722.081587:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788638722.784128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788638722.784139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788638723.105848:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638724.130117:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638725.151991:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638726.179802:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638727.200907:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788638727.905159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788638727.905169:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788638728.224217:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638729.248181:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638730.272085:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638730.336053:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638720/real 1788638720] req@ffff9c73ad30ce00 x1875523183692800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788638730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638730.336093:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73ad30ce00 x1875523183692800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788638730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788638730.336111:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b576a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788638730.336183:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183692800:0@lo:39:umount.0 00000100:00080000:1.0:1788638730.339235:0:17845:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638730.339244:0:17845:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788638730.339251:0:17845:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788638730.340868:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.340887:0:17845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.340895:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.340902:0:17845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.341000:0:17845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638730.341009:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.341017:0:17845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.341024:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.341044:0:17845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342544:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638730.342555:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342564:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031c00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638730.342568:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342577:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638730.342583:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638730.342589:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638730.342591:0:14384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788638730.342602:0:14384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:3.0:1788638730.342605:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342612:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342639:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638730.342643:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342661:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638730.342664:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.342670:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638730.342983:0:17845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788638730.342991:0:17845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788638730.342995:0:17845:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788638730.343045:0:17845:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788638730.343049:0:17845:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788638730.343054:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638730.343070:0:17845:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788638730.343075:0:17845:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c73ad9c0000) has no exports 00000020:00080000:1.0:1788638730.343100:0:17845:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c73ad9c0000) has no exports 10000000:00010000:3.0:1788638730.345047:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638730.345055:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788638730.345067:0:14384:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788638730.345069:0:14384:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788638730.345086:0:14384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:3.0:1788638730.345090:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.345097:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.345118:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638730.345120:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788638730.345595:0:17845:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7398407300 - data ffff9c73bfa37360/ffff9c73ae0e9400 00000020:01000000:1.0:1788638730.345748:0:17845:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73bf723c00 - data ffff9c73a7967798/ffff9c72810b7800 00010000:00010000:2.0:1788638730.346322:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638730.352507:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788638730.361074:0:17845:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788638730.391992:0:17845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2ba9d 00000020:00000080:3.0:1788638730.392008:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c738734c800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788638730.392184:0:17845:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bf0eb800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788638730.392189:0:17845:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bf0eb800 2 00000020:01000004:3.0:1788638730.392192:0:17845:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73bf0eb800 from lustre-OST0001 00000020:00000080:3.0:1788638730.392252:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638730.392272:0:17845:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788638730.392275:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c73acdc1000/lustre-OST0001_UUID 00000020:00000080:3.0:1788638730.392278:0:17845:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc1000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788638730.392284:0:17845:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788638730.392423:0:17845:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS 00010000:00010000:3.0:1788638730.392439:0:17845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638730.392451:0:17845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638730.392458:0:17845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788638730.392460:0:17845:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788638730.392464:0:17845:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788638730.392477:0:17845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:3.0:1788638730.392481:0:17845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638730.392496:0:17845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638730.392503:0:17845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638730.392509:0:17845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638730.392511:0:17845:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788638730.392513:0:17845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788638730.392521:0:17845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c738364a800 00010000:00010000:3.0:1788638730.392524:0:17845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788638730.392540:0:17845:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788638730.392549:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788638730.392552:0:17845:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788638730.392553:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788638730.392559:0:17845:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788638730.392574:0:17845:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73b7c47480 x1875523183692672/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788638732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788638730.392660:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788638730.392664:0:17845:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788638730.392816:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183692672:0@lo:250:kworker.0 10000000:01000000:3.0:1788638730.392894:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788638730.392901:0:17845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2b812 00000020:00000080:0.0:1788638730.392910:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c738734c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788638730.392921:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c738364d000/d97ff07e-b3b5-4ef8-bed3-2a6960653930 00000020:01000000:3.0:1788638730.392931:0:17845:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.134@tcp (flags='') 00000020:00000080:3.0:1788638730.392935:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638730.392940:0:17845:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788638730.392944:0:17845:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c7387d4b380) has no exports 00000020:00000080:0.0:1788638730.392947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c738364d000/d97ff07e-b3b5-4ef8-bed3-2a6960653930 for MGC192.168.203.134@tcp 10000000:01000000:1.0:1788638730.393103:0:14391:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788638730.393343:0:17845:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.134@tcp: client import never connected 00000100:00080000:3.0:1788638730.393347:0:17845:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788638730.393349:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788638730.393351:0:17845:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788638730.393353:0:17845:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788638730.393442:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638730.393447:0:17845:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.134@tcp (uuid d97ff07e-b3b5-4ef8-bed3-2a6960653930) 00000020:01000000:3.0:1788638730.393453:0:17845:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788638730.393457:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638730.393460:0:17845:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788638730.393465:0:17845:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c7398b8e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788638730.393474:0:17845:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9c73bce3cd40) has exports, disconnecting them 00000020:00080000:3.0:1788638730.393478:0:17845:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c7398b8e000), last request at 1788638649 00000020:00000080:3.0:1788638730.393482:0:17845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2bac7 00000020:00080000:3.0:1788638730.393498:0:17845:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7398b8e000): rc 0 00000020:00000080:3.0:1788638730.393502:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c7398b8e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788638730.393534:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c738364a800 for MGC192.168.203.134@tcp 00000020:00000080:1.0:1788638730.393539:0:37:0:(genops.c:885:class_export_put()) final put ffff9c738364d800/d97ff07e-b3b5-4ef8-bed3-2a6960653930 00000020:00000080:1.0:1788638730.393542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c738364d800/d97ff07e-b3b5-4ef8-bed3-2a6960653930 for MGC192.168.203.134@tcp 00000020:01000000:1.0:1788638730.393549:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.134@tcp (d97ff07e-b3b5-4ef8-bed3-2a6960653930) 00000020:00000080:1.0:1788638730.394829:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7398b8e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788638730.396255:0:17845:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788638730.396270:0:17845:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788638730.396275:0:17845:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788638730.396448:0:17845:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788638730.396654:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b576a800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788638730.396762:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788638730.397527:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788638730.397693:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788638730.398678:0:14378:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c738366da00:14378] 0 exiting: rc = 1 00000100:00100000:1.0:1788638730.398820:0:16511:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c73ad39b400:16511] 2 exiting: rc = 0 00000100:00100000:0.0:1788638730.399991:0:14379:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c73882daa00:14379] 1 exiting: rc = 0 00000100:00100000:1.0:1788638730.400408:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.400686:0:14380:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c73b7ced400:14380] 0 exiting: rc = 1 00000100:00100000:2.0:1788638730.400842:0:14382:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c7387321400:14382] 2 exiting: rc = 0 00000100:00100000:2.0:1788638730.401068:0:14381:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c7387321c00:14381] 1 exiting: rc = 0 00000100:00100000:1.0:1788638730.401568:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401576:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401591:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401596:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401604:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401610:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401615:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401621:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401627:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401633:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401639:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401646:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401652:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401662:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401669:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401674:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401679:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401684:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401689:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401694:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401700:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401705:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401710:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401715:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401720:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401725:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401730:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401735:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401745:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.401875:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402190:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402196:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402202:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402207:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402213:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402218:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402224:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402364:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402369:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402375:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402381:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402387:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402394:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402402:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402410:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402420:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402426:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402525:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402535:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402543:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402555:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402561:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402566:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402571:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402576:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402581:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402586:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402590:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402595:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402600:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402605:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402611:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402615:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.402620:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788638730.404272:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638730.404348:0:17845:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788638730.404378:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c73b576c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788638730.404383:0:17845:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b576c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788638730.404390:0:17845:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788638730.404428:0:17845:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bf0eb800 1 00000020:00000080:1.0:1788638730.404438:0:17845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2ba81 00000020:00000080:1.0:1788638730.404476:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c73b55a7800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788638730.404493:0:17845:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788638730.404501:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638730.404506:0:17845:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788638730.404510:0:17845:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c7387d499c0) has no exports 00000020:00000080:0.0:1788638730.404528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b55a7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788638730.428615:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638730.428630:0:17845:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788638730.428635:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c73bf0e8800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788638730.428639:0:17845:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf0e8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788638730.428645:0:17845:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788638730.429637:0:17845:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c73bf0e9800 00000020:01000000:0.0:1788638730.429660:0:17845:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788638730.429665:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638730.429670:0:17845:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788638730.429674:0:17845:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c73ae390000) has no exports 00000020:00000080:0.0:1788638730.430984:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638730.430998:0:17845:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788638730.431004:0:17845:0:(genops.c:885:class_export_put()) final put ffff9c73bf669000/OSS_uuid 00000020:00000080:0.0:1788638730.431008:0:17845:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf669000/OSS_uuid for OSS 00000020:01000000:0.0:1788638730.431014:0:17845:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788638730.431150:0:16638:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c73ad6e6000:16638] 3 exiting: rc = 0 00000100:00100000:1.0:1788638730.431251:0:15077:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c7384d92e00:15077] 0 exiting: rc = 1 00000100:00080000:2.0:1788638730.431325:0:14390:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788638730.431427:0:15078:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c7384d93a00:15078] 1 exiting: rc = 0 00000100:00100000:0.0:1788638730.433010:0:15079:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c7384d93c00:15079] 2 exiting: rc = 0 00000100:00100000:1.0:1788638730.434428:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434459:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434465:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434470:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434474:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434479:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434484:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434489:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434495:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434501:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434508:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434514:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434519:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434523:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434529:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434533:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434538:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434542:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434547:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434551:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434557:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434562:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434567:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434572:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434584:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434591:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434596:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434615:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434619:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434624:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434630:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434635:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434641:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434647:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434653:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434658:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434664:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434669:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434674:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434678:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434683:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434687:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434693:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434699:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434704:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434708:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434713:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434717:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434722:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434726:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434730:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434735:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434741:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434747:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434751:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434756:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434760:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434765:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434769:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434773:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434777:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434805:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434820:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.434825:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638730.435731:0:15080:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c73bf12cc00:15080] 0 exiting: rc = 1 00000100:00100000:0.0:1788638730.435990:0:15081:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c7283015e00:15081] 1 exiting: rc = 0 00000100:00100000:1.0:1788638730.436161:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436167:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436172:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436178:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436182:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436187:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436420:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436427:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436432:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436437:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436442:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436447:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436451:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436455:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436460:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436464:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436469:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436474:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436478:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436483:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436487:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436491:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436496:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436500:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436504:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436509:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436512:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436516:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436520:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436524:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436563:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436569:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436574:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436592:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436596:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436601:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436606:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436611:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436616:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436621:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436627:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436632:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436638:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436646:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436651:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436655:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436660:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436665:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436670:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436675:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436680:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436684:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436690:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436695:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436700:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436705:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436709:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436714:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436718:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436725:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436730:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436735:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436739:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.436745:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.438002:0:16630:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff9c7398418400:16630] 5 exiting: rc = 0 00000100:00100000:3.0:1788638730.438174:0:16627:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9c73bf6ece00:16627] 3 exiting: rc = 0 00000100:00100000:0.0:1788638730.438217:0:15084:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c738366ca00:15084] 2 exiting: rc = 0 00000100:00100000:2.0:1788638730.438416:0:15082:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c7385336200:15082] 0 exiting: rc = 1 00000100:00100000:3.0:1788638730.438430:0:16629:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9c7283016a00:16629] 4 exiting: rc = 0 00000100:00100000:3.0:1788638730.438677:0:15083:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c7385336e00:15083] 1 exiting: rc = 0 00000100:00100000:1.0:1788638730.438768:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438776:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438882:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438890:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438907:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438914:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438920:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438926:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438933:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438939:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438945:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438951:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438957:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438963:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438970:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438976:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438981:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438987:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438992:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.438997:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439002:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439008:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439013:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439020:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439043:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439050:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439066:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439073:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439079:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439263:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439269:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439275:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439280:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439286:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439292:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439297:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439302:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439307:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439312:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439326:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439332:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439338:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439344:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439350:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439356:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439362:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439368:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439375:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439395:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439402:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439408:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439413:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439419:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439424:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439429:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439434:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439440:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439445:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439450:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439455:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439468:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439474:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439480:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638730.439491:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638730.444647:0:15086:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c738366d200:15086] 1 exiting: rc = 0 00000100:00100000:2.0:1788638730.444896:0:15085:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c738366c200:15085] 0 exiting: rc = 1 00000100:00100000:0.0:1788638730.444990:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.444998:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445003:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445009:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445029:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445034:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445039:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445045:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445051:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445064:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445071:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445078:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445084:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445088:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445093:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445098:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445103:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445108:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445113:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445119:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445124:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445129:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445134:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445139:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445144:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445148:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445155:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445160:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445167:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445172:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445177:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445182:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445187:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445192:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445207:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445212:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445217:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445221:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445226:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445237:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445243:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445251:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445256:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445261:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445267:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445272:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445277:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445282:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445287:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445292:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445298:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445304:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445309:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445314:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445319:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445324:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445329:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445334:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445339:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445345:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445350:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445355:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445360:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.445365:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638730.446100:0:15088:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c7390be7800:15088] 1 exiting: rc = 0 00000100:00100000:2.0:1788638730.446240:0:15087:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c738366ce00:15087] 0 exiting: rc = 1 00000100:00100000:0.0:1788638730.446364:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446391:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446398:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446405:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446412:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446418:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446424:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446430:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446437:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446443:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446461:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446466:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446472:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446493:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446500:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446508:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446515:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446521:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446526:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446532:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446537:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446543:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446548:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446554:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446561:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446582:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446589:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446594:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446601:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446607:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446613:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446619:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446624:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446630:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446635:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446640:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446646:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446665:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446671:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446676:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446683:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446689:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446695:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446701:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446707:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446720:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446726:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446731:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446737:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446758:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446765:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446770:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.446776:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447065:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447073:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447079:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447084:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447091:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447096:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447103:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447109:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447119:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447132:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638730.447138:0:17845:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788638730.458128:0:17845:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788638746.111009:0:18463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788638754.400990:0:18924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788638754.400995:0:18924:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788638754.401094:0:18924:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73bc901800 00000020:01000004:0.0:1788638754.401110:0:18924:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788638754.401118:0:18924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788638754.401131:0:18924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c73bce3b380) 00000020:00000080:0.0:1788638754.401144:0:18924:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788638754.415071:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788638754.417443:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788638754.418106:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 441: rc = 0 00100000:10000000:0.0:1788638754.418206:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 441: rc = 0 00100000:10000000:0.0:1788638754.418351:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 441: rc = 0 00100000:10000000:0.0:1788638754.418536:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788638754.418612:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 441: rc = 0 00100000:10000000:0.0:1788638754.418971:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 441: rc = 0 00100000:10000000:0.0:1788638754.419077:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:0.0:1788638754.419374:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 443: rc = 0 00100000:10000000:0.0:1788638754.420657:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 461: rc = 0 00100000:10000000:0.0:1788638754.421013:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 461: rc = 0 00100000:10000000:0.0:1788638754.421399:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 675: rc = 0 00100000:10000000:0.0:1788638754.422054:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.422317:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.422558:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.423235:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 675: rc = 0 00100000:10000000:0.0:1788638754.423488:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 675: rc = 0 00100000:10000000:0.0:1788638754.424028:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 675: rc = 0 00100000:10000000:0.0:1788638754.424280:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 675: rc = 0 00100000:10000000:0.0:1788638754.424527:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.425024:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.425264:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638754.425508:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 675: rc = 0 00100000:10000000:0.0:1788638754.426196:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 691: rc = 0 00100000:10000000:0.0:1788638754.426464:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 691: rc = 0 00100000:10000000:0.0:1788638754.426956:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 691: rc = 0 00100000:10000000:0.0:1788638754.427196:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 691: rc = 0 00100000:10000000:0.0:1788638754.427441:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 691: rc = 0 00100000:10000000:0.0:1788638754.427984:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 691: rc = 0 00100000:10000000:0.0:1788638754.428242:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 691: rc = 0 00100000:10000000:0.0:1788638754.428498:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 691: rc = 0 00100000:10000000:0.0:1788638754.428994:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 691: rc = 0 00100000:10000000:0.0:1788638754.429269:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 691: rc = 0 00100000:10000000:0.0:1788638754.429516:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 691: rc = 0 00100000:10000000:0.0:1788638754.430037:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 691: rc = 0 00100000:10000000:0.0:1788638754.430249:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 691: rc = 0 00100000:10000000:0.0:1788638754.430484:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 691: rc = 0 00100000:10000000:0.0:1788638754.430940:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 691: rc = 0 00100000:10000000:0.0:1788638754.431159:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 691: rc = 0 00100000:10000000:0.0:1788638754.431396:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 691: rc = 0 00100000:10000000:0.0:1788638754.431741:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 691: rc = 0 00100000:10000000:0.0:1788638754.432231:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 691: rc = 0 00100000:10000000:0.0:1788638754.432481:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 691: rc = 0 00100000:10000000:0.0:1788638754.433054:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 691: rc = 0 00100000:10000000:0.0:1788638754.433334:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 691: rc = 0 00100000:10000000:0.0:1788638754.433582:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 691: rc = 0 00100000:10000000:0.0:1788638754.434270:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 691: rc = 0 00100000:10000000:0.0:1788638754.434519:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 691: rc = 0 00100000:10000000:0.0:1788638754.435020:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 691: rc = 0 00100000:10000000:0.0:1788638754.435266:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 691: rc = 0 00100000:10000000:0.0:1788638754.435512:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 691: rc = 0 00100000:10000000:0.0:1788638754.436099:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 691: rc = 0 00100000:10000000:0.0:1788638754.436361:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 691: rc = 0 00100000:10000000:0.0:1788638754.436608:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 691: rc = 0 00100000:10000000:0.0:1788638754.437084:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 691: rc = 0 00100000:10000000:0.0:1788638754.437437:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 471: rc = 0 00100000:10000000:1.0:1788638754.440590:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788638754.441055:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:1.0:1788638754.441402:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788638754.441475:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:1.0:1788638754.442000:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788638754.442078:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:1.0:1788638754.442438:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788638754.442519:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 462: rc = 0 00100000:10000000:1.0:1788638754.442983:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788638754.443045:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 462: rc = 0 00100000:10000000:1.0:1788638754.443227:0:18924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788638754.443296:0:18924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 462: rc = 0 00000020:00000080:1.0:1788638754.443555:0:18924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788638754.443563:0:18924:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788638754.443574:0:18924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2beef 00000020:01000004:1.0:1788638754.443582:0:18924:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788638754.443587:0:18924:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788638754.443593:0:18924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73bc901800 from MGS 00000020:01000004:1.0:1788638754.443596:0:18924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788638754.443606:0:18924:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c73ad9c19c0) 00000020:00000080:1.0:1788638754.443616:0:18924:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788638754.444007:0:18924:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bc901800 from MGS, refs=2 00080000:01000000:1.0:1788638754.444012:0:18924:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638754.444019:0:18924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2befd 00000100:00100000:1.0:1788638754.444110:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788638754.444233:0:18924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788638754.444239:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788638754.445220:0:18924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788638754.445229:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788638754.446240:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638754.446392:0:18924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788638754.446397:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788638754.447100:0:18924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788638754.447108:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788638754.447420:0:18924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788638754.447427:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788638754.448584:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.448588:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.448590:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.449268:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.449271:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.449273:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638754.450104:0:18924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788638754.451869:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788638754.463385:0:18924:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788638754.463403:0:18924:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788638754.463412:0:18924:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788638754.466423:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788638754.466585:0:18924:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788638754.466715:0:18924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788638754.467679:0:18924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788638754.468136:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638754.468308:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788638754.468314:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788638754.474497:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788638754.474513:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788638754.477179:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788638754.477192:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788638754.482057:0:18938:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788638754.482172:0:18924:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788638754.482196:0:18924:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.134@tcp' 00000020:01000004:3.0:1788638754.482198:0:18924:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788638754.482229:0:18924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.134@tcp (typ=mgc) 00000020:00000080:3.0:1788638754.482242:0:18924:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.134@tcp (ffff9c7387d499c0) 00000020:00000080:3.0:1788638754.482257:0:18924:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788638754.482334:0:18924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bf72d000@MGC192.168.203.134@tcp: add connection 192.168.203.134@tcp at head 00010000:00010000:3.0:1788638754.484039:0:18924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.134@tcp-0 is initialized 00000040:01000000:3.0:1788638754.484050:0:18924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788638754.485765:0:18939:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788638754.486678:0:18924:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.134@tcp (uuid 83477f13-c5f9-4c4e-acd2-08466075bc00) 00000020:00000080:3.0:1788638754.486704:0:18924:0:(genops.c:1385:class_connect()) connect: client 83477f13-c5f9-4c4e-acd2-08466075bc00, cookie 0xa0b1f1e3b4b2bf0b 00000100:00080000:3.0:1788638754.486716:0:18924:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788638754.486722:0:18924:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import ffff9c73bf72d000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638754.486755:0:18924:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c44a80 x1875523183692928/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638754.486811:0:18924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 83477f13-c5f9-4c4e-acd2-08466075bc00->MGS 00000100:00100000:2.0:1788638754.487146:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83477f13-c5f9-4c4e-acd2-08466075bc00:3290:1875523183692928:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788638754.487215:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.487289:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183692928 00000100:00100000:2.0:1788638754.487297:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183692928 00000100:00100000:2.0:1788638754.487336:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638754.487343:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1875523183692928:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788638754.487366:0:18934:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 83477f13-c5f9-4c4e-acd2-08466075bc00@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1788638754.487393:0:18934:0:(genops.c:1385:class_connect()) connect: client 83477f13-c5f9-4c4e-acd2-08466075bc00, cookie 0xa0b1f1e3b4b2bf12 00000100:00080000:2.0:1788638754.487521:0:18934:0:(import.c:65:import_set_state_nolock()) ffff9c7281190000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638754.487573:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+5:3290:x1875523183692928:12345-0@lo:250:mount.lustre.0 Request processed in 229us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.487582:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638754.487617:0:3290:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788638754.487626:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.134@tcp: connect to target with instance 0 00000100:00080000:2.0:1788638754.487633:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788638754.487638:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788638754.487641:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf72d000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788638754.487644:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788638754.487663:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788638754.487681:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83477f13-c5f9-4c4e-acd2-08466075bc00:3290:1875523183692928:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1788638754.490169:0:18924:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788638754.490181:0:18924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788638754.490197:0:18924:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c7387d4b380) 00000020:00000080:3.0:1788638754.490211:0:18924:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788638754.509773:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638754.510080:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638754.510086:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788638754.511348:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788638754.511359:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788638754.512147:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638754.512154:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788638754.513017:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638754.513174:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788638754.513179:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788638754.514190:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788638754.514198:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788638754.568081:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638754.568267:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788638754.568274:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788638754.569332:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788638754.569342:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788638754.571025:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638754.571195:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788638754.571201:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788638754.573277:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638754.573289:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788638754.575902:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638754.576085:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788638754.576091:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788638754.578427:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638754.578439:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788638754.579426:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638754.579603:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638754.579609:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788638754.580498:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638754.580506:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788638754.600592:0:18924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638754.601211:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638754.601219:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788638754.602600:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788638754.602610:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788638754.603482:0:18924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638754.603491:0:18924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788638754.604628:0:18924:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788638754.604650:0:18924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788638754.604657:0:18924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788638754.605055:0:18924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788638754.605088:0:18924:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788638754.605092:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788638754.605094:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788638754.605098:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638754.605099:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638754.605100:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638754.605101:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638754.605102:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788638754.605103:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788638754.605104:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638754.605105:0:18924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788638754.605107:0:18924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788638754.605109:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788638754.605110:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788638754.605111:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638754.605112:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638754.605113:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638754.605114:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638754.605115:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788638754.605116:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788638754.605116:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638754.605117:0:18924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788638754.605216:0:18924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788638754.605235:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788638754.605302:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.605385:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638754.605452:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693056 00000100:00100000:1.0:1788638754.605460:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693056 00000100:00100000:1.0:1788638754.605544:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638754.605554:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+5:18924:x1875523183693056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638754.605594:0:18937:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788638754.605597:0:18937:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788638754.605600:0:18937:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788638754.606087:0:18958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788638754.606432:0:18937:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1788638754.607726:0:18959:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788638754.607733:0:18959:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788638754.607736:0:18959:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788638754.607774:0:18959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788638754.608398:0:18937:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788638754.608409:0:18937:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788638754.628699:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+5:18924:x1875523183693056:12345-0@lo:253:mount.lustre.0 Request processed in 23140us (23390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.628700:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788638754.628712:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1788638754.628717:0:18924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788638754.628720:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638754.628721:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788638754.628723:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638754.628724:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638754.628725:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638754.628727:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638754.628728:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788638754.628729:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788638754.628731:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638754.628732:0:18924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788638754.628756:0:18924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73bc901800 from lustre-MDT0000 10000000:01000000:3.0:1788638754.629029:0:18924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788638754.629032:0:18924:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788638754.629037:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7387d499c0 10000000:01000000:3.0:1788638754.629041:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638754.629048:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7387d499c0 from 1 10000000:01000000:3.0:1788638754.629050:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788638754.629085:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.629147:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.629157:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638754.629178:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638754.629302:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638754.629343:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738802acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638754.629399:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693184 00000100:00100000:2.0:1788638754.629481:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693184 00000100:00100000:2.0:1788638754.629563:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638754.629571:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+5:18924:x1875523183693184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638754.629581:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638754.629591:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2bf27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bf20 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.629620:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2bf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf20 expref: 6 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.629640:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2bf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf20 expref: 6 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.629649:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:2.0:1788638754.629679:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+6:18924:x1875523183693184:12345-0@lo:101:mount.lustre.0 Request processed in 109us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.629684:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638754.630064:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638754.630075:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.630082:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638754.630130:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638754.630152:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.630168:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.630223:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693312 00000100:00100000:3.0:1788638754.630228:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693312 00000100:00100000:3.0:1788638754.630364:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638754.630373:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+6:18924:x1875523183693312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638754.630590:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+6:18924:x1875523183693312:12345-0@lo:501:mount.lustre.0 Request processed in 218us (436us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638754.630609:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638754.630618:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693312:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788638754.630640:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788638754.630659:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.630667:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638754.630675:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73bc901800 10000000:01000000:2.0:1788638754.630686:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788638754.630689:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c73bc901800 10000000:01000000:2.0:1788638754.630692:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788638754.630695:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c73bc901800 from 1 10000000:01000000:2.0:1788638754.630697:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788638754.630716:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.630723:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.630732:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638754.630744:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638754.630768:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.630819:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.630992:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693440 00000100:00100000:3.0:1788638754.630997:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693440 00000100:00100000:3.0:1788638754.631024:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638754.631030:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+6:18924:x1875523183693440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638754.631045:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638754.631056:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bf35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bf2e expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631070:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf2e expref: 7 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631079:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf2e expref: 7 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631086:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fcc00, rc 0) 00000100:00100000:3.0:1788638754.631117:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+7:18924:x1875523183693440:12345-0@lo:101:mount.lustre.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.631123:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638754.631224:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638754.631236:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf35 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.631243:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bf35 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638754.631254:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788638754.631271:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf35 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.631278:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2bf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf35 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638754.631290:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788638754.631293:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638754.631297:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c73bc901800 10000000:01000000:2.0:1788638754.631300:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788638754.631302:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788638754.631305:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788638754.631318:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.631325:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.631332:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638754.631343:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638754.631366:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.631389:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.631531:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693568 00000100:00100000:3.0:1788638754.631535:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693568 00000100:00100000:3.0:1788638754.631564:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638754.631571:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+7:18924:x1875523183693568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638754.631578:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638754.631586:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2bf43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bf3c expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631690:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf3c expref: 8 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631699:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bf3c expref: 8 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.631706:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd800, rc 0) 00000100:00100000:3.0:1788638754.632077:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+8:18924:x1875523183693568:12345-0@lo:101:mount.lustre.0 Request processed in 505us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.632084:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638754.632145:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638754.632156:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf43 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.632164:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bf43 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638754.632259:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638754.632284:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.632356:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.632389:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693696 00000100:00100000:3.0:1788638754.632394:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693696 00000100:00100000:3.0:1788638754.632519:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788638754.632526:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+8:18924:x1875523183693696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638754.632949:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18924:x1875523183693696:12345-0@lo:501:mount.lustre.0 Request processed in 423us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.632957:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638754.632982:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.633035:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.633075:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.633774:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638754.634031:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693824 00000100:00100000:2.0:1788638754.634038:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693824 00000100:00100000:2.0:1788638754.634084:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638754.634094:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18924:x1875523183693824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.634825:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183693824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638754.635023:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18924:x1875523183693824:12345-0@lo:503:mount.lustre.0 Request processed in 618us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.635033:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638754.636152:0:18960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18960:1875523183693952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638754.636209:0:18960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.636246:0:18960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.636398:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183693952 00000100:00100000:3.0:1788638754.636414:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183693952 00000100:00100000:3.0:1788638754.636455:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638754.636468:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18960:x1875523183693952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638754.636989:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18960:x1875523183693952:12345-0@lo:502:llog_process_th.0 Request processed in 527us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.636998:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638754.637113:0:18960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18960:1875523183693952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638754.637307:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638754.637320:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.637322:0:18960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788638754.637330:0:18960:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788638754.637334:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788638754.637350:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c73bce3cd40) 00000020:00000080:0.0:1788638754.637366:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788638754.637374:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788638754.637455:0:18960:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788638754.637462:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2bf51 00000020:00000080:0.0:1788638754.637826:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788638754.637832:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638754.637836:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.637838:0:18960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788638754.637841:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638754.637845:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.637847:0:18960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788638754.637851:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788638754.637859:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c73bce399c0) 00000020:00000080:0.0:1788638754.637870:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788638754.637874:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788638754.637876:0:18960:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788638754.637879:0:18960:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788638754.637884:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788638754.637934:0:18960:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bc901800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788638754.637948:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c73bce38000) 00000020:00000080:0.0:1788638754.637962:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788638754.638016:0:18960:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788638754.638022:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2bf66 00000020:00000080:0.0:1788638754.638103:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788638754.638109:0:18960:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788638754.638114:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa0b1f1e3b4b2bf6d 00080000:01000000:0.0:1788638754.638119:0:18960:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788638754.638123:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2bf74 00010000:00010000:2.0:1788638754.723885:0:18960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788638754.724542:0:18960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788638754.724965:0:18960:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788638754.725779:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c73ae3919c0) 00000020:00000080:2.0:1788638754.725819:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788638754.725907:0:18960:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788638754.725915:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2bf82 00000020:00000080:2.0:1788638754.726746:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788638754.735363:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa0b1f1e3b4b2bf89 00000020:00000080:1.0:1788638754.735902:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788638754.735912:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638754.735918:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638754.735921:0:18960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788638754.735924:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788638754.735927:0:18960:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788638754.735929:0:18960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788638754.735930:0:18960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788638754.735932:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788638754.735934:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638754.735936:0:18960:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788638754.735944:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638754.735950:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638754.735952:0:18960:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788638754.735957:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788638754.735993:0:18960:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788638754.736013:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638754.736017:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638754.736018:0:18960:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788638754.736021:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638754.736024:0:18960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788638754.736027:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638754.736028:0:18960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788638754.736031:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788638754.736035:0:18960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:1.0:1788638754.736074:0:18960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788638754.736078:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638754.736091:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c73ad9c4d40) 00000020:00000080:1.0:1788638754.736104:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788638754.736108:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788638754.736308:0:18960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788638754.736313:0:18960:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788638754.736320:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2bf97 00010000:00080000:1.0:1788638754.736352:0:18960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7398781000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:1.0:1788638754.738282:0:18960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788638754.739019:0:18960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788638754.739067:0:18960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788638754.743294:0:18960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638754.745871:0:18960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788638754.747021:0:18960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788638754.749504:0:18964:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788638754.749512:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788638754.753532:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638754.753549:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638754.753591:0:18960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788638754.753612:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2bf9e 00000100:00080000:2.0:1788638754.753624:0:18960:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638754.753630:0:18960:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7398781000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638754.753685:0:18960:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad6c0380 x1875523183694080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638754.753718:0:18960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788638754.753815:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638754.753820:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.753822:0:18960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788638754.753825:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788638754.753828:0:18960:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788638754.753830:0:18960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638754.753831:0:18960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638754.753832:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788638754.753835:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.753836:0:18960:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788638754.753839:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638754.753842:0:18960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788638754.753845:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.753846:0:18960:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788638754.753849:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788638754.753853:0:18960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:2.0:1788638754.753875:0:18960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788638754.753878:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638754.753889:0:18960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c73ae393380) 00000020:00000080:2.0:1788638754.753914:0:18960:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788638754.753918:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788638754.753973:0:18960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788638754.753979:0:18960:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788638754.753985:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2bfac 00010000:00080000:2.0:1788638754.754015:0:18960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7387025000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638754.754208:0:18960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788638754.754404:0:18960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788638754.754427:0:18960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788638754.754986:0:18960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638754.755054:0:18960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788638754.755134:0:18960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:0.0:1788638754.755838:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183694080:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788638754.755915:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183694080 offset 0 length 520: 4 00000040:00080000:2.0:1788638754.758061:0:18966:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788638754.758070:0:18966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788638754.758940:0:18960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638754.758953:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638754.758985:0:18960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788638754.759004:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2bfb3 00000100:00080000:2.0:1788638754.759013:0:18960:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638754.759018:0:18960:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7387025000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638754.759063:0:18960:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad6c0700 x1875523183694208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638754.759081:0:18960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788638754.759142:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638754.759146:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.759148:0:18960:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788638754.759151:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638754.759156:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.759157:0:18960:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788638754.759160:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788638754.759161:0:18960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788638754.759163:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638754.759165:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.759166:0:18960:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788638754.759169:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638754.759171:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.759172:0:18960:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788638754.759175:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788638754.759203:0:18960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18960:1875523183694336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638754.759282:0:18960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638754.759316:0:18960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219900 going to sleep for 11 seconds 00000100:00100000:0.0:1788638754.759522:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183694208:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788638754.759553:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183694208 offset 0 length 520: 4 00000100:00100000:1.0:1788638754.759654:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694336 00000100:00100000:1.0:1788638754.759668:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694336 00000100:00100000:1.0:1788638754.759712:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788638754.759720:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18960:x1875523183694336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638754.759985:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18960:x1875523183694336:12345-0@lo:502:llog_process_th.0 Request processed in 265us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638754.759993:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638754.760316:0:18960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18960:1875523183694336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788638754.760350:0:18960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638754.760355:0:18960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638754.760356:0:18960:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788638754.760362:0:18960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788638754.760495:0:18924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788638754.760511:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788638754.760532:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf43 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.760543:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d800/0xa0b1f1e3b4b2bf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf43 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638754.760552:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73bc901800 from 1 10000000:01000000:0.0:1788638754.760554:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638754.760582:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.760590:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.760599:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.760625:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788638754.760672:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.760702:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638754.760831:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694464 00000100:00100000:2.0:1788638754.760837:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694464 00000100:00100000:2.0:1788638754.760922:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638754.760930:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+9:18924:x1875523183694464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638754.760940:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638754.760953:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bfba expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.760973:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 10 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.760984:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 10 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638754.760992:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c800, rc 0) 00000100:00100000:2.0:1788638754.761021:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+10:18924:x1875523183694464:12345-0@lo:101:mount.lustre.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.761027:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638754.761092:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638754.761105:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.761114:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.761660:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694592:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788638754.761701:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.765845:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.766636:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694592 00000100:00100000:3.0:1788638754.766656:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694592 00000100:00100000:3.0:1788638754.766703:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638754.766714:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+10:18924:x1875523183694592:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788638754.766738:0:18937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788638754.766747:0:18937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788638754.766864:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+10:18924:x1875523183694592:12345-0@lo:256:mount.lustre.0 Request processed in 151us (5161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.766872:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638754.767725:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694592:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788638754.769637:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788638754.770038:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.770051:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638754.770060:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bc901800 from 1 10000000:01000000:0.0:1788638754.770063:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638754.770103:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.770124:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.770504:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.770530:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788638754.770593:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.770636:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.770848:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694720 00000100:00100000:3.0:1788638754.770864:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694720 00000100:00100000:3.0:1788638754.770921:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638754.770931:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+10:18924:x1875523183694720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638754.770943:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638754.770956:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bfc8 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.770979:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 11 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.770990:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 11 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.770999:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd000, rc 0) 00000100:00100000:3.0:1788638754.771042:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183694720:12345-0@lo:101:mount.lustre.0 Request processed in 112us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.771049:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638754.771249:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638754.771263:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.771272:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.771331:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.771359:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.771913:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638754.772255:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694848 00000100:00100000:1.0:1788638754.772261:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694848 00000100:00100000:1.0:1788638754.772308:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638754.772316:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183694848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638754.773043:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183694848:12345-0@lo:501:mount.lustre.0 Request processed in 726us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638754.773052:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638754.773170:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.773214:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.773259:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.773292:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638754.773397:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183694976 00000100:00100000:2.0:1788638754.773411:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183694976 00000100:00100000:2.0:1788638754.773448:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638754.773456:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183694976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638754.773610:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183694976:12345-0@lo:503:mount.lustre.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.773627:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638754.773940:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183694976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.774370:0:18968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18968:1875523183695104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638754.774428:0:18968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.774489:0:18968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638754.774557:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695104 00000100:00100000:2.0:1788638754.774563:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695104 00000100:00100000:2.0:1788638754.774596:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638754.774604:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18968:x1875523183695104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638754.775084:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18968:x1875523183695104:12345-0@lo:502:llog_process_th.0 Request processed in 480us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.775092:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638754.775269:0:18968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18968:1875523183695104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638754.775296:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638754.775306:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.775309:0:18968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788638754.775318:0:18968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bc901800 00000020:00000080:0.0:1788638754.775321:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788638754.775329:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638754.775332:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.775334:0:18968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788638754.775337:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638754.775339:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.775340:0:18968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788638754.775344:0:18968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bc901800 00000020:00000080:0.0:1788638754.775346:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788638754.775483:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638754.775488:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.775489:0:18968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788638754.775492:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638754.775495:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.775496:0:18968:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788638754.775500:0:18968:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73bc901800 00000020:00000080:0.0:1788638754.775502:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638754.776261:0:18968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18968:1875523183695232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638754.776319:0:18968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.776394:0:18968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638754.780241:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695232 00000100:00100000:1.0:1788638754.780255:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695232 00000100:00100000:1.0:1788638754.780320:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638754.780331:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18968:x1875523183695232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638754.780883:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18968:x1875523183695232:12345-0@lo:502:llog_process_th.0 Request processed in 552us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638754.780901:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638754.781007:0:18968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18968:1875523183695232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638754.781043:0:18968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638754.781057:0:18968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638754.781059:0:18968:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788638754.781064:0:18968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788638754.781282:0:18924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788638754.781299:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638754.781317:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.781329:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638754.781385:0:18924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638754.781388:0:18924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73bc901800 10000000:01000000:1.0:1788638754.781392:0:18924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73bc901800 10000000:01000000:1.0:1788638754.781396:0:18924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638754.781457:0:18924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bc901800 from 1 10000000:01000000:1.0:1788638754.781461:0:18924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638754.781492:0:18924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.781502:0:18924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.781511:0:18924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638754.781532:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788638754.781574:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638754.781610:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398724180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638754.781636:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695360 00000100:00100000:1.0:1788638754.782259:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695360 00000100:00100000:1.0:1788638754.782339:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638754.782348:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183695360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638754.782360:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638754.782375:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5568800/0xa0b1f1e3b4b2bfdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bfd6 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.782400:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5568800/0xa0b1f1e3b4b2bfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfd6 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.782432:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5568800/0xa0b1f1e3b4b2bfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfd6 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.782441:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568800, rc 0) 00000100:00100000:1.0:1788638754.782484:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183695360:12345-0@lo:101:mount.lustre.0 Request processed in 138us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638754.782490:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638754.791287:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638754.791318:0:18924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfdd expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.791332:0:18924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bfdd expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.791411:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.791470:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.791515:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638754.793278:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695488 00000100:00100000:0.0:1788638754.793290:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695488 00000100:00100000:0.0:1788638754.793337:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638754.793347:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183695488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.793637:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183695488:12345-0@lo:501:mount.lustre.0 Request processed in 291us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638754.793660:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638754.793715:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638754.793760:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.793821:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.793849:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638754.793864:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695616 00000100:00100000:0.0:1788638754.793868:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695616 00000100:00100000:0.0:1788638754.793886:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638754.793913:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183695616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.794059:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183695616:12345-0@lo:503:mount.lustre.0 Request processed in 146us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638754.794066:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638754.794104:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183695616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638754.794292:0:18972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18972:1875523183695744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638754.794325:0:18972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638754.794344:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695744 00000100:00100000:0.0:1788638754.794348:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695744 00000100:00100000:0.0:1788638754.794370:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638754.794376:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18972:x1875523183695744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638754.794519:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18972:x1875523183695744:12345-0@lo:502:llog_process_th.0 Request processed in 142us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638754.794526:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638754.794554:0:18972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969780 going to sleep for 11 seconds 00000100:00100000:0.0:1788638754.794565:0:18972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18972:1875523183695744:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788638754.794620:0:18972:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788638754.794634:0:18972:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c73880a99c0) 00000020:00000080:0.0:1788638754.794653:0:18972:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788638754.794722:0:18972:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bc901800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788638754.794726:0:18972:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bc901800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788638754.794729:0:18972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bc901800 4 00010000:00080000:0.0:1788638754.794754:0:18972:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73ad6eb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:0.0:1788638754.796429:0:18972:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788638754.802213:0:18972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788638754.802255:0:18972:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788638754.802266:0:18972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa0b1f1e3b4b2bfeb 00000100:00080000:1.0:1788638754.802278:0:18972:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638754.802284:0:18972:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c73ad6eb800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638754.802319:0:18972:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad30e300 x1875523183695872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788638754.802343:0:18972:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788638754.804397:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183695872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788638754.804468:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638754.804541:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183695872 00000100:00100000:1.0:1788638754.804548:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183695872 00000100:00100000:1.0:1788638754.804581:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638754.804587:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183695872:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788638754.804634:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183695872:12345-0@lo:38:llog_process_th.0 Request processed in 46us (166us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788638754.804743:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638754.804776:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638754.805718:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788638754.805731:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788638754.805735:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183695872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788638754.805860:0:18972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18972:1875523183696000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638754.805921:0:18972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638754.805940:0:18972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398724240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638754.807442:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696000 00000100:00100000:0.0:1788638754.807454:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696000 00000100:00100000:0.0:1788638754.807509:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638754.807517:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18972:x1875523183696000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638754.809863:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18972:x1875523183696000:12345-0@lo:502:llog_process_th.0 Request processed in 2329us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638754.809877:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788638754.816267:0:18972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83477f13-c5f9-4c4e-acd2-08466075bc00:18972:1875523183696000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788638754.816313:0:18972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788638754.816946:0:18924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788638754.816968:0:18924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638754.816983:0:18924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfdd expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638754.816995:0:18924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5568000/0xa0b1f1e3b4b2bfd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bfdd expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638754.817045:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638754.817048:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638754.817049:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638754.817050:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638754.817052:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638754.817053:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638754.817055:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638754.817056:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638754.817058:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638754.817059:0:18924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638754.817064:0:18924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788638754.817066:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638754.817068:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638754.817069:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638754.817070:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638754.817071:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638754.817072:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638754.817080:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638754.817081:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638754.817082:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638754.817083:0:18924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638754.817108:0:18924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788638754.817125:0:18924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183696128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788638754.817280:0:18924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638754.817319:0:18924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398724d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638754.817348:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696128 00000100:00100000:1.0:1788638754.817356:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696128 00000100:00100000:1.0:1788638754.817405:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638754.817414:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18924:x1875523183696128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638754.817442:0:18937:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788638754.817457:0:18937:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788638754.867692:0:18937:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788638754.867711:0:18937:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788638754.869008:0:18958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788638754.869018:0:18958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788638754.869040:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.869059:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.869068:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.869109:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.869303:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 12 pid: 18936 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638754.869318:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183696256:0@lo:104: 00000100:00100000:3.0:1788638754.869381:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638754.869419:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638754.869457:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696256 00000100:00100000:3.0:1788638754.869464:0:18925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696256 00000100:00100000:3.0:1788638754.869505:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638754.869513:0:18925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183696256:12345-0@lo:104: 00010000:00010000:3.0:1788638754.869527:0:18925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.869573:0:18925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638754.869580:0:18925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183696256:12345-0@lo:104: Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638754.869586:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638754.869625:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183696256:0@lo:104: 00010000:00010000:3.0:1788638754.871028:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871052:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638754.871059:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871066:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638754.871070:0:18931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871091:0:18931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638754.871099:0:18931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638754.871105:0:18931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638754.871396:0:18931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871404:0:18931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788638754.871466:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183696384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638754.871522:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638754.871583:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871592:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5467400/0xa0b1f1e3b4b2bfba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfc1 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.871607:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.871609:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638754.871611:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638754.873998:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696384 00000100:00100000:0.0:1788638754.874010:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696384 00010000:00010000:0.0:1788638754.874042:0:18927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 13 pid: 18936 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638754.874077:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638754.874087:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+13:3291:x1875523183696384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638754.874100:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638754.874105:0:18927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 13 pid: 18936 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874117:0:18927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 13 pid: 18936 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874232:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2bfc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfba expref: 13 pid: 18936 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874250:0:18927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874258:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788638754.874291:0:18927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005274101s 00010000:00010000:0.0:1788638754.874295:0:18927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874302:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874310:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874316:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874321:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638754.874324:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874332:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874352:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638754.874362:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638754.874427:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:3291:x1875523183696384:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638754.874434:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638754.874473:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183696384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638754.874526:0:18958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.874535:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638754.874542:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2bff2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638754.874658:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18924:x1875523183696128:12345-0@lo:253:mount.lustre.0 Request processed in 57243us (57376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638754.874667:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638754.874827:0:18924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:18924:1875523183696128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788638754.874845:0:18924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788638754.874848:0:18924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638754.874850:0:18924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638754.874955:0:18924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638754.874957:0:18924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638754.874958:0:18924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638754.874959:0:18924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638754.874960:0:18924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638754.874962:0:18924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638754.874963:0:18924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638754.874964:0:18924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788638754.874976:0:18924:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638754.882121:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.882383:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638754.882740:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.883306:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638754.883599:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.884059:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638754.885272:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.885445:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638754.885742:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.886511:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638754.887052:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638754.887265:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788638754.910090:0:18924:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:1.0:1788638754.910586:0:18924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788638754.910979:0:18982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788638754.911054:0:18982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788638754.915216:0:18981:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:0.0:1788638754.915224:0:18981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:01000000:1.0:1788638754.916097:0:18924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788638754.916342:0:18924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788638754.916745:0:18924:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788638754.916752:0:18924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788638754.917070:0:18982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788638754.917236:0:18982:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788638754.917241:0:18982:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788638754.917428:0:18924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638754.919006:0:18924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788638754.919580:0:18924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788638754.919613:0:18924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788638754.921337:0:18924:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788638754.922974:0:18924:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788638754.928664:0:18924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788638754.963552:0:18924:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788638754.963589:0:18924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd48818d7988 00100000:10000000:0.0:1788638754.963597:0:18924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788638754.964709:0:18924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638754.964725:0:18924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638754.964752:0:18924:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788638754.964822:0:18924:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788638755.488951:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788638755.872200:0:18976:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788638755.872211:0:18976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638755.876507:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788638755.877326:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788638756.320043:0:18939:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788638756.320051:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73bc901800 from 9 10000000:01000000:1.0:1788638756.320056:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788638756.320104:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638756.320116:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638756.320127:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638756.320154:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183696512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638756.320222:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638756.320282:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638756.320350:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696512 00000100:00100000:3.0:1788638756.320357:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696512 00000100:00100000:3.0:1788638756.320412:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638756.320422:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18939:x1875523183696512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638756.320435:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638756.320448:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bff9 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.320469:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.320479:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.320488:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd200, rc 0) 00000100:00100000:3.0:1788638756.320530:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183696512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638756.320537:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638756.320580:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183696512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638756.320594:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.320602:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638756.320664:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183696640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788638756.320694:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638756.320716:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638756.320955:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696640 00000100:00100000:1.0:1788638756.320965:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696640 00000100:00100000:1.0:1788638756.320987:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788638756.320992:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183696640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788638756.321006:0:18934:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788638756.321022:0:18934:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788638756.321026:0:18934:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788638756.321094:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183696640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638756.321100:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788638756.321167:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183696640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788638756.321208:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788638756.321215:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.321223:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638756.515481:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638756.900306:0:18976:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788638756.900944:0:18976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638756.901752:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788638756.901929:0:18976:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638756.901966:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788638757.535910:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638758.565272:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638759.428443:0:19225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638759.584048:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638760.161819:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638760.161825:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638760.161827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638760.161830:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638760.161833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788638760.161836:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788638760.161839:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638760.161849:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c73ad6eb800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638760.161885:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad30ce00 x1875523183696896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638760.162023:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183696768:0@lo:400:kworker.0 00000100:00100000:1.0:1788638760.162094:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638760.162153:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696768 00000100:00100000:1.0:1788638760.162159:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696768 00000100:00100000:1.0:1788638760.162206:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788638760.162220:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:3292:x1875523183696768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638760.162270:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:3292:x1875523183696768:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638760.162277:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788638760.162317:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183696768:0@lo:400:kworker.0 00000100:00100000:1.0:1788638760.162342:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183696896:0@lo:38:kworker.0 00000100:00100000:1.0:1788638760.162367:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638760.162447:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183696896 00000100:00100000:2.0:1788638760.162451:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183696896 00000100:00100000:2.0:1788638760.162480:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638760.162485:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1875523183696896:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788638760.162504:0:18944:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788638760.162535:0:18944:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa0b1f1e3b4b2c007 00000004:00100000:2.0:1788638760.162548:0:18944:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788638760.162667:0:18944:0:(import.c:65:import_set_state_nolock()) ffff9c73ad474000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638760.162715:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875523183696896:12345-0@lo:38:kworker.0 Request processed in 220us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638760.162727:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788638760.162759:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73ad30ce00 x1875523183696896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788638760.162772:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788638760.162779:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788638760.162802:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788638760.162804:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788638760.162810:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183696896:0@lo:38:kworker.0 00010000:00010000:3.0:1788638760.608046:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638761.633180:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788638762.309596:0:19376:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd809acd50 20000000:00000080:3.0:1788638762.309613:0:19376:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73b7c75000 uarg=0000000000000000 20000000:01000000:3.0:1788638762.309725:0:19376:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788638762.309733:0:19376:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788638762.309738:0:19376:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788638762.311101:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788638762.311382:0:19376:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788638762.317103:0:19376:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788638762.317381:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.317401:0:19376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 11 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.317409:0:19376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.317464:0:19376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 11 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.317477:0:19376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 11 pid: 18937 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638762.317492:0:19376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19376:1875523183697024:0@lo:104: 00000100:00100000:3.0:1788638762.317551:0:19376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638762.317648:0:19376:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7390d7f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638762.318751:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697024 00000100:00100000:0.0:1788638762.318760:0:18926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697024 00000100:00100000:0.0:1788638762.319013:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638762.319025:0:18926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+3:19376:x1875523183697024:12345-0@lo:104: 00010000:00010000:0.0:1788638762.319040:0:18926:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638762.319133:0:18926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638762.319148:0:18926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+3:19376:x1875523183697024:12345-0@lo:104: Request processed in 126us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638762.319156:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638762.319247:0:19376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19376:1875523183697024:0@lo:104: 00010000:00010000:2.0:1788638762.319272:0:19376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.320925:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638762.320936:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.320947:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638762.320951:0:18931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.320961:0:18931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638762.320968:0:18931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638762.320974:0:18931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788638762.321024:0:18931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.321031:0:18931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638762.321061:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.321086:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bfc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2bfcf expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638762.321103:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638762.321105:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638762.321106:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638762.321339:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183697152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638762.321400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638762.321508:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697152 00000100:00100000:3.0:1788638762.321516:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697152 00010000:00010000:3.0:1788638762.321544:0:18928:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 12 pid: 18937 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638762.321761:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638762.321772:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+12:3293:x1875523183697152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638762.321816:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638762.321821:0:18928:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 12 pid: 18937 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321833:0:18928:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 12 pid: 18937 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321857:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2bfcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bfc8 expref: 12 pid: 18937 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321872:0:18928:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321891:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321907:0:18928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321913:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321919:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321925:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321929:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fda00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638762.321933:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321939:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321956:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638762.321965:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638762.322009:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+11:3293:x1875523183697152:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638762.322016:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788638762.322074:0:19376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638762.322083:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638762.322088:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c00e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638762.322465:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183697152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638762.656926:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638763.681363:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788638763.939516:0:18939:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638763.939522:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bc901800 from 10 10000000:01000000:0.0:1788638763.939526:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638763.939576:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638763.939598:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638763.939613:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638763.939646:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638763.939719:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638763.939804:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383079240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638763.940332:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697280 00000100:00100000:2.0:1788638763.940341:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697280 00000100:00100000:2.0:1788638763.940439:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638763.940449:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+11:18939:x1875523183697280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638763.940463:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638763.940477:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c015 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638763.940503:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638763.940532:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638763.940542:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:2.0:1788638763.940595:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183697280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638763.940602:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638763.940681:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638763.940697:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638763.940718:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638763.940805:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638763.940847:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638763.942695:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697408 00000100:00100000:1.0:1788638763.942708:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697408 00000100:00100000:1.0:1788638763.942754:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638763.942763:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183697408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638763.943027:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383079240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638763.943310:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183697408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 547us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638763.943318:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788638763.943420:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638763.943464:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638763.943505:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638763.943529:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383079240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638763.943693:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697536 00000100:00100000:1.0:1788638763.943699:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697536 00000100:00100000:1.0:1788638763.943770:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638763.943779:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183697536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638763.943960:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+12:18939:x1875523183697536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638763.943967:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788638763.944043:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183697536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788638763.950338:0:19437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638763.950585:0:18939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638763.950606:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638763.950616:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638763.950700:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638764.258919:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638754/real 1788638754] req@ffff9c73ad6c0700 x1875523183694208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638764.258949:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73ad6c0700 x1875523183694208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638764.258970:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638754/real 1788638754] req@ffff9c73ad6c0380 x1875523183694080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638764.258982:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73ad6c0380 x1875523183694080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788638764.259001:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638764.259023:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788638764.259027:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183694208:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788638764.259034:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638764.259038:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788638764.259041:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183694080:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788638764.259151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638764.259156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788638764.259159:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638764.259164:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1788638764.259169:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788638764.259174:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7398781000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638764.259218:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c46d80 x1875523183697664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638764.259237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638764.259240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788638764.259241:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638764.259244:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1788638764.259247:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788638764.259249:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7387025000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638764.259259:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c45f80 x1875523183697792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638764.259294:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638764.259304:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183697920:0@lo:400:kworker.0 00000100:00100000:3.0:1788638764.259376:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638764.259447:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183697920 00000100:00100000:3.0:1788638764.259455:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183697920 00000100:00100000:3.0:1788638764.259496:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638764.259507:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183697920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638764.259553:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183697920:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638764.259559:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788638764.259593:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73b7c45500 x1875523183697920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638764.259603:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183697920:0@lo:400:kworker.0 00000100:00100000:2.0:1788638764.260213:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183697664:0@lo:8:kworker.0 00000400:00000100:2.0:1788638764.260257:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183697664 offset 0 length 520: 4 00000100:00100000:2.0:1788638764.260284:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183697792:0@lo:8:kworker.0 00000400:00000100:2.0:1788638764.260317:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183697792 offset 0 length 520: 4 00010000:00010000:1.0:1788638764.705764:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638765.729936:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638766.112428:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788638766.752565:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788638767.303429:0:19626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788638767.303432:0:19626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788638767.303542:0:19626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7387348000 00000020:01000004:3.0:1788638767.303557:0:19626:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788638767.303569:0:19626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788638767.303581:0:19626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c7387d4cd40) 00000020:00000080:3.0:1788638767.303597:0:19626:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788638767.350314:0:19626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788638767.350607:0:19626:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788638767.357777:0:19626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788638767.358477:0:19626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788638767.358703:0:19626:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788638767.359709:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 545: rc = 0 00100000:10000000:1.0:1788638767.359900:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:1.0:1788638767.360000:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 545: rc = 0 00100000:10000000:1.0:1788638767.360740:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 674: rc = 0 00100000:10000000:1.0:1788638767.363246:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 674: rc = 0 00100000:10000000:1.0:1788638767.364099:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 674: rc = 0 00100000:10000000:1.0:1788638767.364354:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 674: rc = 0 00100000:10000000:1.0:1788638767.364628:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 674: rc = 0 00100000:10000000:1.0:1788638767.366423:0:19626:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 674: rc = 0 00000020:00000080:1.0:1788638767.373991:0:19626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788638767.374006:0:19626:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788638767.374031:0:19626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2c02a 00000020:01000004:1.0:1788638767.374039:0:19626:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788638767.374410:0:19626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788638767.374414:0:19626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788638767.374421:0:19626:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788638767.374426:0:19626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788638767.374439:0:19626:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c73ad9c3380) 00000020:00000080:1.0:1788638767.374450:0:19626:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788638767.375718:0:19626:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638767.376169:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788638767.376176:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788638767.383228:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788638767.383244:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788638767.387019:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788638767.387035:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788638767.389225:0:19626:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638767.389416:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788638767.389423:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788638767.392962:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788638767.392977:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788638767.414226:0:19626:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638767.414462:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788638767.414469:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788638767.423115:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788638767.423138:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788638767.431456:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788638767.431480:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788638767.434132:0:19626:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638767.434316:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788638767.434322:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788638767.435684:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788638767.435696:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788638767.472911:0:19626:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638767.473129:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788638767.473135:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788638767.474309:0:19626:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788638767.474318:0:19626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788638767.474695:0:19626:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788638767.474720:0:19626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788638767.474726:0:19626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788638767.498720:0:19626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788638767.498757:0:19626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788638767.498762:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788638767.498763:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638767.498764:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638767.499624:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638767.499625:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638767.499627:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638767.499629:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638767.499630:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638767.499640:0:19626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638767.499644:0:19626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788638767.499647:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638767.499648:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638767.499649:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638767.499650:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638767.499651:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638767.499652:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638767.499653:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638767.499654:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638767.499655:0:19626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638767.499690:0:19626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788638767.499710:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788638767.499933:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638767.500014:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638767.500114:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698048 00000100:00100000:2.0:1788638767.500122:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698048 00000100:00100000:2.0:1788638767.500227:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638767.500238:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+12:19626:x1875523183698048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788638767.500276:0:18936:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788638767.500279:0:18936:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788638767.500283:0:18936:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788638767.509713:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+12:19626:x1875523183698048:12345-0@lo:253:mount.lustre.0 Request processed in 9469us (9772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638767.509728:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638767.509902:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788638767.509918:0:19626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788638767.509921:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638767.509923:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788638767.509924:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638767.509926:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638767.509927:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638767.509928:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638767.509930:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638767.509932:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638767.509933:0:19626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788638767.509966:0:19626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7387348000 from lustre-OST0000 10000000:01000000:2.0:1788638767.509989:0:19626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788638767.510003:0:19626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788638767.510009:0:19626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7387d499c0 local copy 00010000:00010000:2.0:1788638767.510017:0:19626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638767.510425:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.510466:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.510830:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.514385:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698176 00000100:00100000:0.0:1788638767.514399:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698176 00000100:00100000:0.0:1788638767.514495:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638767.514506:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:19626:x1875523183698176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638767.514971:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:19626:x1875523183698176:12345-0@lo:501:mount.lustre.0 Request processed in 467us (4503us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638767.514980:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788638767.517886:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698176:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788638767.517921:0:19626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788638767.518635:0:19626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788638767.518646:0:19626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.518657:0:19626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638767.518683:0:19626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7387348000 10000000:01000000:2.0:1788638767.518689:0:19626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788638767.518694:0:19626:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7387d499c0 10000000:01000000:2.0:1788638767.518697:0:19626:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788638767.518700:0:19626:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7387d499c0 from 1 10000000:01000000:2.0:1788638767.518703:0:19626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788638767.518738:0:19626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.518747:0:19626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.518873:0:19626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638767.518897:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638767.518957:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.519213:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.519312:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698304 00000100:00100000:0.0:1788638767.519319:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698304 00000100:00100000:0.0:1788638767.519407:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638767.519418:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+12:19626:x1875523183698304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638767.519432:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638767.519446:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5466e00/0xa0b1f1e3b4b2c03f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c038 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638767.519470:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5466e00/0xa0b1f1e3b4b2c03f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c038 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638767.519483:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5466e00/0xa0b1f1e3b4b2c03f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c038 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638767.519492:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466e00, rc 0) 00000100:00100000:0.0:1788638767.519540:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+13:19626:x1875523183698304:12345-0@lo:101:mount.lustre.0 Request processed in 124us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.519547:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788638767.519625:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638767.519640:0:19626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c03f expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.519650:0:19626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c03f expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638767.519669:0:19626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788638767.519680:0:19626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c03f expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.519688:0:19626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c200/0xa0b1f1e3b4b2c038 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c03f expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638767.519695:0:19626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788638767.519699:0:19626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638767.519704:0:19626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788638767.519706:0:19626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788638767.519722:0:19626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.519729:0:19626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.519744:0:19626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638767.519757:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638767.519825:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.520062:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638767.520155:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698432 00000100:00100000:1.0:1788638767.520161:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698432 00000100:00100000:1.0:1788638767.520189:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638767.520196:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+13:19626:x1875523183698432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638767.520203:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638767.520212:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2c04d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c046 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.520239:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2c04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c046 expref: 14 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.520247:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2c04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c046 expref: 14 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.520254:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568e00, rc 0) 00000100:00100000:1.0:1788638767.520295:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698432:12345-0@lo:101:mount.lustre.0 Request processed in 100us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638767.520302:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788638767.520373:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638767.520384:0:19626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c04d expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.520392:0:19626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c04d expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638767.521212:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788638767.522485:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638767.522723:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788638767.524617:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788638767.524696:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788638767.524798:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788638767.524851:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788638767.524887:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788638767.524938:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788638767.524972:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788638767.525002:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788638767.525121:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788638767.525164:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788638767.525249:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788638767.525330:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788638767.525338:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788638767.525465:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.525532:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.525746:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638767.525997:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698560 00000100:00100000:1.0:1788638767.526006:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698560 00000100:00100000:1.0:1788638767.526156:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638767.526167:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638767.526572:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698560:12345-0@lo:501:mount.lustre.0 Request processed in 406us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638767.526580:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788638767.526658:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.526698:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638767.526741:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.527077:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.527235:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698688 00000100:00100000:0.0:1788638767.527241:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698688 00000100:00100000:0.0:1788638767.527270:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788638767.527278:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638767.527601:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698688:12345-0@lo:503:mount.lustre.0 Request processed in 323us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.527616:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788638767.527725:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698688:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788638767.528481:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638767.528545:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638767.528598:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.528638:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.528994:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698816 00000100:00100000:0.0:1788638767.529000:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698816 00000100:00100000:0.0:1788638767.529030:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788638767.529038:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638767.529262:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698816:12345-0@lo:502:mount.lustre.0 Request processed in 224us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.529270:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788638767.529512:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638767.529719:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788638767.530679:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788638767.530732:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788638767.531144:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788638767.531181:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788638767.531209:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788638767.531267:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788638767.531299:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788638767.531328:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788638767.531367:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788638767.531396:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788638767.531437:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788638767.531479:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638767.531551:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.531603:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.532004:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183698944 00000100:00100000:0.0:1788638767.532011:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183698944 00000100:00100000:0.0:1788638767.532124:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788638767.532134:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638767.532387:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183698944:12345-0@lo:502:mount.lustre.0 Request processed in 254us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.532395:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788638767.532653:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183698944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638767.532737:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788638767.532749:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788638767.534112:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638767.534122:0:19640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788638767.534129:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638767.534131:0:19640:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788638767.534137:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638767.534151:0:19640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c73ad9c0000) 00000020:00000080:1.0:1788638767.534172:0:19640:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788638767.534177:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638767.534306:0:19640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7387348000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788638767.534313:0:19640:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638767.534320:0:19640:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2c05b 00010000:00010000:0.0:1788638767.541113:0:19640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788638767.545242:0:19640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:0.0:1788638767.547639:0:19640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788638767.550843:0:19640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788638767.550856:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638767.550862:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550864:0:19640:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788638767.550872:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788638767.550875:0:19640:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788638767.550877:0:19640:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788638767.550878:0:19640:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788638767.550880:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788638767.550883:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550885:0:19640:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788638767.550887:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638767.550890:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550892:0:19640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638767.550895:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638767.550896:0:19640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788638767.550899:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638767.550901:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550902:0:19640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788638767.550905:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638767.550907:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550914:0:19640:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788638767.550919:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788638767.550983:0:19640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638767.550987:0:19640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638767.550989:0:19640:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788638767.550993:0:19640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788638767.551345:0:19626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788638767.551377:0:19626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788638767.551444:0:19626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c04d expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.551457:0:19626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2c046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c04d expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638767.551465:0:19626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387348000 from 1 10000000:01000000:2.0:1788638767.551468:0:19626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638767.551501:0:19626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.551510:0:19626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.551520:0:19626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638767.551543:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638767.551610:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.551654:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638767.551707:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699072 00000100:00100000:3.0:1788638767.551714:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699072 00000100:00100000:3.0:1788638767.551759:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788638767.551778:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+14:19626:x1875523183699072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638767.551824:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638767.551837:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c062 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.551861:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 15 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.551873:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 15 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.551882:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc600, rc 0) 00000100:00100000:3.0:1788638767.551922:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699072:12345-0@lo:101:mount.lustre.0 Request processed in 146us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638767.551929:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788638767.555593:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638767.555622:0:19626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.555645:0:19626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638767.556310:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788638767.556620:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638767.558349:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788638767.558429:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788638767.558480:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788638767.558521:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788638767.558557:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788638767.558608:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788638767.558646:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788638767.558679:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788638767.561354:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788638767.561413:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788638767.561534:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.561603:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.561638:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638767.561734:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699200 00000100:00100000:1.0:1788638767.561743:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699200 00000100:00100000:1.0:1788638767.561838:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788638767.561847:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638767.562926:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699200:12345-0@lo:501:mount.lustre.0 Request processed in 1076us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638767.562937:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788638767.563253:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.563302:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638767.563348:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.563379:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699328 00000100:00100000:2.0:1788638767.563385:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699328 00000100:00100000:2.0:1788638767.563520:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788638767.563530:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638767.563692:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699328:12345-0@lo:503:mount.lustre.0 Request processed in 163us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638767.563709:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788638767.567031:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638767.567070:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788638767.568382:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638767.568481:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638767.568560:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.568602:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638767.568704:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699456 00000100:00100000:3.0:1788638767.568712:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699456 00000100:00100000:3.0:1788638767.568756:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788638767.568765:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638767.569001:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699456:12345-0@lo:502:mount.lustre.0 Request processed in 236us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638767.569019:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788638767.569183:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638767.569397:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788638767.569444:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788638767.569495:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788638767.569535:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788638767.569585:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788638767.569632:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788638767.569668:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788638767.569698:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788638767.569724:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638767.569763:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638767.569832:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383912b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638767.570019:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699584 00000100:00100000:3.0:1788638767.570024:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699584 00000100:00100000:3.0:1788638767.570127:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788638767.570136:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638767.570289:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699584:12345-0@lo:502:mount.lustre.0 Request processed in 153us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638767.570296:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788638767.570415:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638767.570499:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788638767.570509:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788638767.571452:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638767.571463:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571465:0:19644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788638767.571472:0:19644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7387348000 00000020:00000080:2.0:1788638767.571474:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788638767.571488:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638767.571491:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571492:0:19644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788638767.571495:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638767.571497:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571498:0:19644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788638767.571501:0:19644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7387348000 00000020:00000080:2.0:1788638767.571502:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788638767.571556:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638767.571560:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571561:0:19644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788638767.571564:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638767.571567:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571568:0:19644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788638767.571572:0:19644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7387348000 00000020:00000080:2.0:1788638767.571574:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788638767.571611:0:19644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638767.571614:0:19644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638767.571616:0:19644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788638767.571618:0:19644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788638767.571749:0:19626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788638767.571824:0:19626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638767.571842:0:19626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.571853:0:19626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638767.571904:0:19626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638767.571907:0:19626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7387348000 10000000:01000000:1.0:1788638767.571910:0:19626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7387348000 10000000:01000000:1.0:1788638767.571915:0:19626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638767.571920:0:19626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7387348000 from 1 10000000:01000000:1.0:1788638767.571923:0:19626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638767.571956:0:19626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.571965:0:19626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.571975:0:19626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638767.571996:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788638767.572165:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.572207:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638767.572255:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699712 00000100:00100000:2.0:1788638767.572261:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699712 00000100:00100000:2.0:1788638767.572302:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788638767.572311:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183699712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638767.572322:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638767.572334:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01c400/0xa0b1f1e3b4b2c077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c070 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.572357:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01c400/0xa0b1f1e3b4b2c077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c070 expref: 16 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.572367:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01c400/0xa0b1f1e3b4b2c077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c070 expref: 16 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638767.572383:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c400, rc 0) 00000100:00100000:2.0:1788638767.572422:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183699712:12345-0@lo:101:mount.lustre.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638767.572429:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788638767.572503:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638767.572517:0:19626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c077 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.572526:0:19626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c077 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788638767.576355:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788638767.580389:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638767.580726:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788638767.587002:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788638767.587169:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788638767.587251:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788638767.587292:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788638767.587345:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788638767.587408:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788638767.587439:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788638767.587488:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788638767.587527:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788638767.587562:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788638767.587610:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788638767.587647:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788638767.587675:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788638767.587718:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788638767.587756:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788638767.590440:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788638767.590566:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788638767.590605:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788638767.590640:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788638767.590685:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788638767.590719:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788638767.592508:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788638767.592617:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788638767.592654:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788638767.592684:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788638767.592724:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788638767.592755:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788638767.593577:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788638767.593643:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788638767.593680:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788638767.593714:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788638767.593746:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788638767.594951:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788638767.595016:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788638767.596678:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788638767.596746:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788638767.597907:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788638767.598015:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788638767.598903:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788638767.599016:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788638767.599024:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788638767.599304:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638767.599385:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.600886:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638767.606163:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699840 00000100:00100000:2.0:1788638767.606177:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699840 00000100:00100000:2.0:1788638767.606240:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788638767.606250:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183699840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638767.617220:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183699840:12345-0@lo:501:mount.lustre.0 Request processed in 10961us (17825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638767.617237:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788638767.617354:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638767.617412:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638767.617478:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.617518:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638767.618352:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183699968 00000100:00100000:3.0:1788638767.618361:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183699968 00000100:00100000:2.0:1788638767.619340:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788638767.619356:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183699968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638767.619590:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183699968:12345-0@lo:503:mount.lustre.0 Request processed in 238us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638767.619598:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788638767.620222:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183699968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788638767.620751:0:19626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638767.620871:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638767.620932:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638767.624342:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73854e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.624400:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700096 00000100:00100000:0.0:1788638767.624409:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700096 00000100:00100000:0.0:1788638767.624456:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788638767.624466:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183700096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638767.624938:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183700096:12345-0@lo:502:mount.lustre.0 Request processed in 472us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.624948:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788638767.630965:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638767.631339:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788638767.631406:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788638767.631444:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788638767.631492:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788638767.631526:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788638767.631567:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788638767.631599:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788638767.631630:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788638767.631696:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788638767.631744:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788638767.632860:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788638767.632951:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788638767.632989:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788638767.633022:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788638767.633350:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788638767.633394:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788638767.633431:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788638767.633481:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788638767.633517:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788638767.633550:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788638767.633599:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788638767.633637:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788638767.633670:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788638767.633718:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788638767.633755:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788638767.633850:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788638767.633903:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788638767.633938:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788638767.633971:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788638767.634020:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788638767.634434:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788638767.634472:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788638767.634506:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788638767.634557:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788638767.634595:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788638767.634647:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788638767.634683:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788638767.634717:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788638767.637230:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788638767.637346:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788638767.637400:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638767.637499:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638767.638236:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384f7a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.639422:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700224 00000100:00100000:0.0:1788638767.639482:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700224 00000100:00100000:0.0:1788638767.639575:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638767.639586:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183700224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638767.639915:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183700224:12345-0@lo:502:mount.lustre.0 Request processed in 331us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.639924:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788638767.640013:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638767.640132:0:19626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788638767.640147:0:19626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788638767.641888:0:19649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788638767.641906:0:19649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c7387d48000) 00000020:00000080:3.0:1788638767.641926:0:19649:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788638767.642004:0:19649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7387348000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788638767.642008:0:19649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7387348000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788638767.642011:0:19649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7387348000 3 00010000:00080000:3.0:1788638767.642165:0:19649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7384d5e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.134@tcp at head 00010000:00010000:1.0:1788638767.645204:0:19649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788638767.645619:0:19649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788638767.645658:0:19649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788638767.645670:0:19649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa0b1f1e3b4b2c085 00000100:00080000:1.0:1788638767.645681:0:19649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638767.645687:0:19649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7384d5e000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638767.645721:0:19649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad30f800 x1875523183700352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788638767.645749:0:19649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788638767.646051:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183700352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788638767.646121:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.646271:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700352 00000100:00100000:1.0:1788638767.646278:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700352 00000100:00100000:1.0:1788638767.646313:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638767.646319:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183700352:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788638767.646347:0:18942:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1788638767.646381:0:18942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa0b1f1e3b4b2c08c 00000004:00100000:1.0:1788638767.646397:0:18942:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788638767.646426:0:18942:0:(import.c:65:import_set_state_nolock()) ffff9c738666e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638767.646489:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875523183700352:12345-0@lo:38:llog_process_th.0 Request processed in 169us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638767.646497:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788638767.646762:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73ad30f800 x1875523183700352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638767.646771:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638767.646779:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788638767.646833:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638767.646839:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788638767.646841:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7384d5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638767.646847:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183700352:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788638767.646992:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788638767.647125:0:19626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788638767.647153:0:19626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638767.647168:0:19626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c077 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.647178:0:19626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5569800/0xa0b1f1e3b4b2c070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c077 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638767.647224:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638767.647226:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638767.647232:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638767.647233:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638767.647235:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638767.647236:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638767.647237:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638767.647239:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638767.647240:0:19626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638767.647244:0:19626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788638767.647246:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638767.647247:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638767.647248:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638767.647249:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638767.647250:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638767.647251:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638767.647252:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638767.647253:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638767.647254:0:19626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638767.647269:0:19626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788638767.647284:0:19626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788638767.647331:0:19626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.647346:0:19626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638767.647494:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700480 00000100:00100000:2.0:1788638767.647500:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700480 00000100:00100000:2.0:1788638767.647535:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788638767.647542:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:19626:x1875523183700480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788638767.647565:0:18937:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788638767.647578:0:18937:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1788638767.651414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638767.651424:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638767.651427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638767.651430:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788638767.656362:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183700608:0@lo:400:kworker.0 00000100:00100000:1.0:1788638767.656430:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638767.658131:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700608 00000100:00100000:1.0:1788638767.658142:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700608 00000100:00100000:1.0:1788638767.658192:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638767.658201:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183700608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638767.658270:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183700608:12345-0@lo:400:kworker.0 Request processed in 70us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638767.658285:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788638767.658326:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73ad30c700 x1875523183700608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638767.658340:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183700608:0@lo:400:kworker.0 20000000:01000000:2.0:1788638767.693216:0:18937:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788638767.693300:0:18937:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788638767.693485:0:18958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788638767.693490:0:18958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788638767.693511:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.693530:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 16 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.693539:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.693576:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 16 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.693591:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 16 pid: 18936 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638767.693605:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183700736:0@lo:104: 00000100:00100000:3.0:1788638767.693668:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638767.693713:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384f7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638767.693959:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700736 00000100:00100000:0.0:1788638767.693967:0:18925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700736 00000100:00100000:0.0:1788638767.694018:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638767.694028:0:18925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183700736:12345-0@lo:104: 00010000:00010000:0.0:1788638767.694136:0:18925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638767.694270:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183700736:0@lo:104: 00010000:00010000:3.0:1788638767.694290:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638767.695990:0:18925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638767.696005:0:18925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183700736:12345-0@lo:104: Request processed in 1975us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.696016:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788638767.703890:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638767.703905:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.703918:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638767.703923:0:18931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.703934:0:18931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638767.703943:0:18931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638767.703950:0:18931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638767.703998:0:18931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.704005:0:18931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638767.704024:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.704032:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5569000/0xa0b1f1e3b4b2bff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c000 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638767.704070:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638767.704072:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638767.704074:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638767.704163:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183700864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638767.704224:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638767.706010:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700864 00000100:00100000:3.0:1788638767.706024:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700864 00010000:00010000:3.0:1788638767.706069:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 17 pid: 18936 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638767.706112:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638767.706122:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:3292:x1875523183700864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638767.706135:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638767.706141:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 17 pid: 18936 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706153:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 17 pid: 18936 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706169:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fd200/0xa0b1f1e3b4b2c000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2bff9 expref: 17 pid: 18936 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706186:0:18929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706194:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638767.706210:0:18929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012720264s 00010000:00010000:3.0:1788638767.706214:0:18929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706246:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706253:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706260:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706265:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638767.706269:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706277:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706294:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706304:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638767.706367:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3292:x1875523183700864:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638767.706374:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638767.706416:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183700864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638767.706443:0:18958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706451:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638767.706467:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2c093 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638767.712882:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+15:19626:x1875523183700480:12345-0@lo:253:mount.lustre.0 Request processed in 65331us (65540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638767.712897:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788638767.715856:0:19626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:19626:1875523183700480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788638767.715877:0:19626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788638767.715880:0:19626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638767.715881:0:19626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638767.715883:0:19626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638767.715884:0:19626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638767.715885:0:19626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638767.715886:0:19626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638767.715888:0:19626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638767.715889:0:19626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638767.715891:0:19626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638767.715910:0:19626:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638767.716348:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638767.716507:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638767.716661:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638767.716850:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638767.716990:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638767.717165:0:19626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788638767.721495:0:19626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1788638767.782676:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788638767.804565:0:19626:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788638767.804574:0:19626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788638767.804611:0:19626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788638767.804669:0:19626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788638767.804685:0:19626:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788638767.804711:0:19626:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788638768.802440:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788638769.311873:0:18939:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788638769.311880:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73bc901800 from 10 10000000:01000000:1.0:1788638769.311886:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788638769.311932:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638769.311944:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638769.311970:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638769.311995:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183700992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638769.312064:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638769.312124:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32600 going to sleep for 11 seconds 00000100:00100000:0.0:1788638769.312456:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183700992 00000100:00100000:0.0:1788638769.312465:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183700992 00000100:00100000:0.0:1788638769.312520:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638769.312530:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+15:18939:x1875523183700992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638769.312543:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638769.312558:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c09a expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638769.312594:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 16 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638769.312605:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 16 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638769.312615:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466800, rc 0) 00000100:00100000:0.0:1788638769.312831:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:18939:x1875523183700992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 302us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638769.312839:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788638769.313169:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183700992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638769.313188:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638769.313198:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638769.313257:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183701120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788638769.313300:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638769.313364:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219900 going to sleep for 11 seconds 00000100:00100000:0.0:1788638769.313399:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701120 00000100:00100000:0.0:1788638769.313404:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701120 00000100:00100000:0.0:1788638769.313436:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788638769.313444:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:18939:x1875523183701120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788638769.313459:0:18937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788638769.313475:0:18937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788638769.313478:0:18937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788638769.313640:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:18939:x1875523183701120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638769.313648:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788638769.313696:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183701120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788638769.313952:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788638769.313960:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638769.313969:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638769.823957:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638770.848565:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638771.872446:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638772.896505:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638772.960051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638772.960058:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788638772.960060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638772.960064:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788638772.960152:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183701376:0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.960214:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638772.960270:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638772.960276:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183701248:0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.960304:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638772.960334:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183701504:0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.960360:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638772.960462:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701376 00000100:00100000:3.0:1788638772.960469:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701376 00000100:00100000:3.0:1788638772.961640:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701504 00000100:00100000:3.0:1788638772.961649:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701504 00000100:00100000:3.0:1788638772.961688:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638772.961697:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183701376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.962984:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183701376:12345-0@lo:400:kworker.0 Request processed in 1281us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638772.962995:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638772.963023:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638772.963034:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183701504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.963081:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183701504:12345-0@lo:400:kworker.0 Request processed in 51us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638772.963100:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638772.963123:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701248 00000100:00100000:3.0:1788638772.963130:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701248 00000100:00100000:3.0:1788638772.963158:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788638772.963165:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3294:x1875523183701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638772.963198:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3294:x1875523183701248:12345-0@lo:400:kworker.0 Request processed in 34us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638772.963204:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788638772.963257:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c47100 x1875523183701504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638772.963272:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183701504:0@lo:400:kworker.0 00000100:00080000:1.0:1788638772.964434:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638772.965649:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183701248:0@lo:400:kworker.0 00010000:00080000:0.0:1788638772.965674:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c47480 x1875523183701376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638772.965685:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183701376:0@lo:400:kworker.0 00010000:00010000:0.0:1788638773.927063:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638773.995711:0:19993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788638774.944143:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638775.967927:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788638776.352952:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788638776.992014:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638778.016176:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638778.080554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638778.080561:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638778.080563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638778.080566:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788638778.080602:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638778.080621:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183701632:0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.080690:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638778.080762:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183701760:0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.080803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638778.080822:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638778.080827:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183701888:0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.080846:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638778.080876:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701632 00000100:00100000:1.0:1788638778.080883:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701632 00000100:00100000:1.0:1788638778.080928:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788638778.080950:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3291:x1875523183701632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.080999:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3291:x1875523183701632:12345-0@lo:400:kworker.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638778.081005:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788638778.081035:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701760 00000100:00100000:1.0:1788638778.081038:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701760 00000100:00100000:1.0:1788638778.081060:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183701888 00000100:00100000:1.0:1788638778.081063:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183701888 00000100:00100000:1.0:1788638778.081082:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638778.081088:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183701760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.081133:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183701760:12345-0@lo:400:kworker.0 Request processed in 45us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638778.081139:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638778.081149:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638778.081155:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183701888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638778.081177:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183701888:12345-0@lo:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638778.081183:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788638778.081206:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638778.081233:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183701632:0@lo:400:kworker.0 00010000:00080000:1.0:1788638778.081264:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30f100 x1875523183701888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638778.081275:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183701888:0@lo:400:kworker.0 00010000:00080000:1.0:1788638778.081285:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30c000 x1875523183701760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638778.081307:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183701760:0@lo:400:kworker.0 00010000:00010000:3.0:1788638779.044587:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638779.935909:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638764/real 1788638764] req@ffff9c73b7c46d80 x1875523183697664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638779.935944:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73b7c46d80 x1875523183697664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638779.935954:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638764/real 1788638764] req@ffff9c73b7c45f80 x1875523183697792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638779.935965:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73b7c45f80 x1875523183697792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788638779.935983:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638779.936009:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788638779.936013:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183697664:0@lo:8:kworker.0 00000100:00080000:2.0:1788638779.936019:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638779.936024:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788638779.936027:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183697792:0@lo:8:kworker.0 00000100:00080000:3.0:1788638779.936463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638779.936467:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788638779.936469:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638779.936474:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1788638779.936479:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788638779.936484:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7398781000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638779.936502:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c46680 x1875523183702144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638779.936520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638779.936523:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788638779.936524:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638779.936542:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1788638779.936545:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788638779.936548:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7387025000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638779.936559:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c44380 x1875523183702272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638779.936813:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183702144:0@lo:8:kworker.0 00000100:00100000:2.0:1788638779.936871:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638779.936913:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183702272:0@lo:8:kworker.0 00000100:00100000:2.0:1788638779.936933:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638779.937007:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183702400:0@lo:400:kworker.0 00000100:00100000:0.0:1788638779.937038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638779.937069:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638779.937075:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183702016:0@lo:400:kworker.0 00000100:00100000:0.0:1788638779.937099:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638779.937126:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702016 00000100:00100000:0.0:1788638779.937133:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702016 00000100:00100000:0.0:1788638779.937174:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638779.937181:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3292:x1875523183702016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638779.937234:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3292:x1875523183702016:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638779.937242:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638779.937282:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183702016:0@lo:400:kworker.0 00000100:00100000:1.0:1788638779.937438:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183702528:0@lo:400:kworker.0 00000100:00100000:1.0:1788638779.937467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638779.937588:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702400 00000100:00100000:0.0:1788638779.937593:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702400 00000100:00100000:0.0:1788638779.937621:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702528 00000100:00100000:0.0:1788638779.937624:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702528 00000100:00100000:0.0:1788638779.937636:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638779.937642:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183702400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638779.937679:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183702400:12345-0@lo:400:kworker.0 Request processed in 37us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638779.937685:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638779.937697:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638779.937703:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183702528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638779.937738:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183702528:12345-0@lo:400:kworker.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638779.937755:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788638779.937811:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c44000 x1875523183702400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638779.937822:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183702400:0@lo:400:kworker.0 00010000:00080000:1.0:1788638779.938535:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c47b80 x1875523183702528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638779.938546:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183702528:0@lo:400:kworker.0 00000100:00100000:3.0:1788638779.938630:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702144 00000100:00100000:3.0:1788638779.938636:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702144 00000100:00100000:3.0:1788638779.938661:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702272 00000100:00100000:3.0:1788638779.938664:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702272 00000100:00100000:3.0:1788638779.938676:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638779.938681:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183702144:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788638779.938704:0:19627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1788638779.938741:0:19627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2c0a8 00002000:00100000:3.0:1788638779.938755:0:19627:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c73bd183800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788638779.938760:0:19627:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788638779.938763:0:19627:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788638779.939113:0:19627:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638779.939138:0:19627:0:(import.c:65:import_set_state_nolock()) ffff9c73bd187800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638779.939205:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183702144:12345-0@lo:8:kworker.0 Request processed in 522us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638779.939213:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638779.939236:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638779.939240:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183702272:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788638779.939251:0:19627:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788638779.939841:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c46680 x1875523183702144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638779.939871:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788638779.939878:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788638779.939886:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788638779.939892:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788638779.939895:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788638779.939911:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788638779.939917:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183702144:0@lo:8:kworker.0 00000004:00080000:0.0:1788638779.940096:0:18965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:0.0:1788638779.940117:0:18965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18965:1875523183702784:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788638779.940158:0:18965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638779.940175:0:18965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386723840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638779.940243:0:19630:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788638779.940251:0:19630:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:1.0:1788638779.940273:0:18964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788638779.940529:0:18964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 543011745385ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788638779.940846:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638779.940859:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183702656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638779.940897:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638779.945953:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702784 00000100:00100000:1.0:1788638779.945966:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702784 00000100:00080000:1.0:1788638779.946026:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638779.946150:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638779.946161:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18965:x1875523183702784:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788638779.952372:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702656 00000100:00100000:2.0:1788638779.952388:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702656 00000100:00100000:2.0:1788638779.952441:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638779.952450:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183702656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638779.952481:0:19631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788638779.952560:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183702656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (11662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638779.952567:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788638779.952608:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdc8a80 x1875523183702656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638779.952629:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183702656:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788638779.959624:0:20262:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788638779.959634:0:20262:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788638779.959639:0:20262:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:0.0:1788638779.973903:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.973915:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.973942:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.973947:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.973955:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.973973:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.973994:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974012:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974031:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638779.974048:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638779.974053:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974060:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638779.974065:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974074:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974089:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974096:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c0af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974112:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.974119:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.974121:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.974568:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.974574:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974582:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.974586:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.974589:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974598:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974605:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974611:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.974627:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638779.975039:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.975045:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975054:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.975057:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.975060:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975076:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975083:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975091:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975105:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788638779.975115:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638779.975120:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975127:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638779.975130:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975138:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975148:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975156:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c0b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975175:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638779.975178:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975184:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638779.975187:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975194:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975203:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975209:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975218:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.975219:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.975221:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.975607:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.975612:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975620:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.975628:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.975632:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975642:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975649:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975655:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.975682:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638779.975742:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638779.975748:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.975755:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638779.975759:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.975778:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.975809:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.975817:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c0c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.975831:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.975832:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.975834:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.976061:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.976067:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.976074:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.976076:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.976080:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.976089:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.976097:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.976108:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.976127:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638779.976399:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638779.976404:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.976412:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638779.976416:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.976424:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.976436:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.976453:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.976868:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.976872:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.976875:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.977553:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.977561:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977572:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.977575:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.977580:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977590:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977599:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977607:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977625:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638779.977634:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638779.977639:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977653:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638779.977657:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977664:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977678:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977686:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.977706:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.977709:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.977712:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.984143:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.984154:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.984171:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.984176:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.984182:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.984196:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.984214:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.984221:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.984242:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638779.984632:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638779.984697:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.984706:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638779.984711:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.984728:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.984744:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.984750:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c0d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.984768:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.984770:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.984771:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638779.985182:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.985188:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.985196:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.985199:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.985204:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.985213:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.985275:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.985283:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.985343:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638779.986598:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.986607:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.986618:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.986622:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.986626:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.986636:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.986644:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.986651:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987013:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638779.987021:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987030:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638779.987034:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987043:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987057:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987064:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c0e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987081:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638779.987084:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987090:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638779.987093:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987099:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987120:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987127:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.987129:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.987131:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638779.987298:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.987396:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638779.987401:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c0e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638779.987910:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638779.990143:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183702272:12345-0@lo:8:kworker.0 Request processed in 50893us (53201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788638779.990167:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788638779.990223:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638779.990228:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788638779.990244:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183702272:0@lo:8:kworker.0 00002000:00010000:0.0:1788638779.998195:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638779.998209:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998233:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638779.998267:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638779.998274:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998290:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998301:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998308:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998329:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638779.998343:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638779.998348:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998355:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638779.998359:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998366:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998395:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998401:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638779.998421:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.998423:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638779.998425:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638780.000561:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638780.000573:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000587:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638780.000592:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638780.000597:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000608:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000618:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000625:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000671:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638780.000684:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.000689:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000696:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.000700:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000708:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000734:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000742:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c0f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.000758:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.000759:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.000761:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638780.005982:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638780.006565:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006585:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638780.006595:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638780.006601:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006616:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006626:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006633:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006666:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638780.006683:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.006689:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006696:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.006700:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006708:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006733:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006752:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c0fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.006775:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.006777:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.006778:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638780.007480:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638780.007487:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.009066:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638780.009076:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638780.009085:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.009104:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.009116:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.009125:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638780.009260:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788638780.011102:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638780.011760:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638780.011774:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.011812:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638780.011817:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638780.011824:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.011839:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.011850:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.011858:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015764:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638780.015779:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015808:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.015813:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015823:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015857:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015865:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c103 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015893:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638780.015897:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015903:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.015914:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015933:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015945:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.015953:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.015955:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.015957:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.018776:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638780.019082:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c10a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.019125:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638780.021580:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638780.021595:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.021611:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788638780.021624:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638780.021631:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.021816:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.021885:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.021894:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.021920:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638780.023175:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638780.023185:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.023196:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638780.023201:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.023210:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.023229:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.023238:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c111 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.023258:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.023266:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.023268:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.023382:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.023389:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.023400:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.023404:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.023409:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.023431:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.023441:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.023447:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.023502:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.024403:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.024409:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.024420:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.024423:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.024427:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.024436:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.024444:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.024460:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024581:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638780.024588:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024596:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.024600:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024608:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024621:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024705:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2c118 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024731:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.024735:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024741:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.024744:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024751:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024761:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.024767:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.024768:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.024770:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.025138:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638780.025143:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2c11f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.026077:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.026119:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.026125:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026137:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.026141:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.026145:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026156:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026164:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026171:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026232:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.026743:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.026750:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026759:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.026762:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.026766:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026776:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026813:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.026821:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027213:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638780.027221:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027230:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.027241:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027251:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027265:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027274:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2c126 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027292:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.027296:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027303:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.027306:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027314:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027323:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.027331:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.027338:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.027341:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.027407:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638780.027413:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2c12d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638780.028359:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.028367:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.028383:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.028387:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.028393:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.028403:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.028413:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.028420:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.032519:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638780.032532:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.032545:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638780.032550:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.032561:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.032579:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.032588:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.032590:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.032591:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.034527:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638780.034540:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2c134 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.034763:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.035764:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.035774:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.037390:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.037396:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.037405:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.037439:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.037452:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.037459:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.037483:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638780.038140:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638780.038148:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.038157:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638780.038161:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.038184:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.038201:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.038210:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2c13b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.038230:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.038232:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.038234:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.042915:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.042932:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.042949:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.042955:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.042962:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.042978:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.042991:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.043137:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.043196:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.046506:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.046519:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.046535:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.046539:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.046545:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.046559:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.046569:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.046577:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047221:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638780.047231:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047240:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638780.047245:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047253:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047271:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047294:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2c142 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047316:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638780.047319:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047326:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638780.047329:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047338:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047348:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638780.047356:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.047357:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638780.047359:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.049232:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.049279:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638780.049291:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2c149 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638780.050930:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.050940:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.050956:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.050960:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.050967:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.050981:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.050991:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051061:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051089:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.051544:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.051550:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051559:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.051622:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.051634:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051645:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051653:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051660:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.051683:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788638780.051738:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638780.051748:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051758:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.051763:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051773:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051813:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051823:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2c150 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051860:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638780.051865:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051871:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.051875:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051883:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051896:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051904:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2c157 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.051919:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.051921:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.051923:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.052094:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.052183:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.052188:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052194:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.052198:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.052202:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052212:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052220:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052239:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052259:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788638780.052479:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638780.052484:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052492:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.052602:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052612:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052624:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052631:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c15e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638780.052686:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.052692:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052700:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.052703:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.052707:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052716:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.052717:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.052728:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.052731:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638780.052740:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052747:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.052768:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638780.052816:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.052822:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.052895:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.052899:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.052908:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.052919:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.052927:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c165 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.052948:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.052951:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.052954:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.053307:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.053313:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053329:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.053332:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.053337:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053348:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053358:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053366:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053389:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.053865:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.053871:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053879:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.053882:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.053887:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053897:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.053908:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638780.053915:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053921:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.053927:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.053933:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053936:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.053952:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.053962:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788638780.053966:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.053981:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c16c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054061:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638780.054066:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054073:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.054077:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054086:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054098:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054106:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c173 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638780.054119:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.054121:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638780.054124:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638780.054439:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.054446:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.054454:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.054458:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.054462:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.054470:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.054479:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.054485:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.054657:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638780.055157:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638780.055163:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.055172:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788638780.055175:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638780.055179:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.055189:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.055197:0:20262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.055204:0:20262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638780.060876:0:20262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788638780.061178:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638780.061188:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061202:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638780.061348:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061361:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061381:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061390:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c17a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061423:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638780.061428:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061434:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638780.061438:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.061438:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061445:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061454:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061460:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c181 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638780.061479:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.061481:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638780.061483:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788638780.062459:0:20262:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1788638780.062577:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18965:x1875523183702784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116415us (122415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638780.062588:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638780.063371:0:18965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18965:1875523183702784:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788638780.063387:0:18965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:1.0:1788638780.063443:0:18965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18965:1875523183702912:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788638780.063485:0:18965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638780.063560:0:18965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bbce0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638780.063602:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183702912 00000100:00100000:2.0:1788638780.063610:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183702912 00000100:00100000:2.0:1788638780.063847:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638780.063860:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18965:x1875523183702912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788638780.063905:0:19630:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:0.0:1788638780.063986:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638780.081218:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18965:x1875523183702912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17354us (17723us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788638780.081244:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638780.081711:0:18965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18965:1875523183702912:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788638780.081738:0:18965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:3.0:1788638781.092058:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788638781.484013:0:20344:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788638781.484017:0:20344:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788638781.484133:0:20344:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73bd185000 00000020:01000004:3.0:1788638781.484149:0:20344:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788638781.484161:0:20344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788638781.484269:0:20344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7282114d40) 00000020:00000080:3.0:1788638781.484288:0:20344:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788638781.525547:0:20344:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788638781.526171:0:20344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788638781.527190:0:20344:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788638781.527421:0:20344:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788638781.539611:0:20344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788638781.541240:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 417: rc = 0 00100000:10000000:1.0:1788638781.541483:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:1.0:1788638781.546367:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:1.0:1788638781.554411:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:1.0:1788638781.554705:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:1.0:1788638781.555514:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:1.0:1788638781.557568:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 771: rc = 0 00100000:10000000:1.0:1788638781.563381:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 771: rc = 0 00100000:10000000:1.0:1788638781.563693:0:20344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 771: rc = 0 00000020:00000080:1.0:1788638781.573528:0:20344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788638781.573542:0:20344:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788638781.573552:0:20344:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2c18f 00000020:01000004:1.0:1788638781.573561:0:20344:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788638781.574171:0:20344:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788638781.574176:0:20344:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788638781.574183:0:20344:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788638781.574208:0:20344:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788638781.574212:0:20344:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788638781.595753:0:20344:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788638781.595815:0:20344:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.134@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788638781.595820:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788638781.595822:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638781.595823:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638781.595824:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638781.595826:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638781.595827:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638781.595828:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638781.595830:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638781.595831:0:20344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638781.595835:0:20344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788638781.595837:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638781.595838:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638781.595839:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638781.595840:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638781.595841:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638781.595842:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638781.595843:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638781.596188:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638781.596197:0:20344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638781.596224:0:20344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788638781.596245:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788638781.596314:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.596368:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.596705:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703040 00000100:00100000:1.0:1788638781.596722:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703040 00000100:00100000:1.0:1788638781.596776:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788638781.596810:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:20344:x1875523183703040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638781.596862:0:18934:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788638781.596865:0:18934:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788638781.596869:0:18934:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788638781.616451:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:20344:x1875523183703040:12345-0@lo:253:mount.lustre.0 Request processed in 19633us (20126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.616464:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788638781.616906:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703040:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788638781.616921:0:20344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788638781.616924:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638781.616926:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638781.616927:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638781.616928:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638781.616930:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638781.616931:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638781.616933:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638781.616944:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638781.616952:0:20344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788638781.616970:0:20344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73bd185000 from lustre-OST0001 10000000:01000000:3.0:1788638781.616997:0:20344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788638781.617000:0:20344:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788638781.617007:0:20344:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7387d499c0 local copy 00010000:00010000:3.0:1788638781.617017:0:20344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.617235:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638781.617276:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.617314:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32900 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.617442:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703168 00000100:00100000:1.0:1788638781.617449:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703168 00000100:00100000:1.0:1788638781.617493:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788638781.617503:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:20344:x1875523183703168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638781.617696:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+16:20344:x1875523183703168:12345-0@lo:501:mount.lustre.0 Request processed in 193us (419us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638781.617704:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788638781.618056:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703168:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788638781.618070:0:20344:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788638781.618214:0:20344:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788638781.618222:0:20344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.618239:0:20344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2bf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bf27 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638781.618260:0:20344:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73bd185000 10000000:01000000:3.0:1788638781.618265:0:20344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788638781.618270:0:20344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788638781.618272:0:20344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638781.618277:0:20344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788638781.618280:0:20344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788638781.618302:0:20344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.618310:0:20344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.618319:0:20344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.618334:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638781.618366:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.618398:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32900 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.619296:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703296 00000100:00100000:1.0:1788638781.619303:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703296 00000100:00100000:1.0:1788638781.619354:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788638781.619363:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+16:20344:x1875523183703296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638781.619375:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638781.619389:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308200/0xa0b1f1e3b4b2c19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c196 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.619412:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308200/0xa0b1f1e3b4b2c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c196 expref: 17 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.619424:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308200/0xa0b1f1e3b4b2c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c196 expref: 17 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.619433:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308200, rc 0) 00000100:00100000:1.0:1788638781.619483:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703296:12345-0@lo:101:mount.lustre.0 Request processed in 122us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.619490:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788638781.619985:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638781.620001:0:20344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c19d expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.620020:0:20344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c19d expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638781.621289:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788638781.630491:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638781.633180:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788638781.633271:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788638781.633306:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788638781.633354:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788638781.633410:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788638781.633448:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788638781.633501:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788638781.633540:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788638781.633611:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788638781.634188:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788638781.634199:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788638781.634326:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638781.634395:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.634439:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581600 going to sleep for 11 seconds 00000100:00100000:0.0:1788638781.634669:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703424 00000100:00100000:0.0:1788638781.634687:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703424 00000100:00100000:0.0:1788638781.634748:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788638781.634758:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638781.635429:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703424:12345-0@lo:501:mount.lustre.0 Request processed in 672us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638781.635438:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638781.637047:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638781.637102:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638781.637165:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.637445:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.638441:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703552 00000100:00100000:1.0:1788638781.638450:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703552 00000100:00100000:1.0:1788638781.638538:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788638781.638557:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638781.639303:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703552:12345-0@lo:503:mount.lustre.0 Request processed in 755us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.639313:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788638781.639400:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788638781.640658:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638781.640753:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638781.641123:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.641207:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.642337:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703680 00000100:00100000:1.0:1788638781.642347:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703680 00000100:00100000:1.0:1788638781.642451:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788638781.642461:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638781.642753:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703680:12345-0@lo:502:mount.lustre.0 Request processed in 293us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.642761:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638781.642899:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638781.643171:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788638781.643222:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788638781.643271:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788638781.643321:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788638781.643359:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788638781.643395:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788638781.643448:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788638781.643505:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788638781.643572:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788638781.643610:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638781.643661:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.644588:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581600 going to sleep for 11 seconds 00000100:00100000:0.0:1788638781.644694:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703808 00000100:00100000:0.0:1788638781.644702:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703808 00000100:00100000:0.0:1788638781.644752:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788638781.644762:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638781.645284:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703808:12345-0@lo:502:mount.lustre.0 Request processed in 523us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638781.645293:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788638781.645562:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638781.645737:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788638781.645751:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788638781.647298:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638781.647308:0:20346:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788638781.647315:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638781.647317:0:20346:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788638781.647324:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638781.647339:0:20346:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c73ae390000) 00000020:00000080:2.0:1788638781.647364:0:20346:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788638781.647370:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788638781.647428:0:20346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bd185000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788638781.647436:0:20346:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788638781.647447:0:20346:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2c1ab 00010000:00010000:2.0:1788638781.652279:0:20346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788638781.653148:0:20346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:2.0:1788638781.664084:0:20346:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1788638781.671966:0:20346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788638781.671979:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638781.671985:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638781.672000:0:20346:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788638781.672005:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638781.672010:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638781.672011:0:20346:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638781.672014:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638781.672016:0:20346:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788638781.672018:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638781.672021:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638781.672022:0:20346:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788638781.672024:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638781.672027:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638781.672028:0:20346:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788638781.672032:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788638781.672235:0:20346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638781.672240:0:20346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638781.672242:0:20346:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788638781.672246:0:20346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788638781.672416:0:20344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788638781.672443:0:20344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788638781.672465:0:20344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c19d expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638781.672485:0:20344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fd000/0xa0b1f1e3b4b2c196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c19d expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638781.672494:0:20344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bd185000 from 1 10000000:01000000:2.0:1788638781.672496:0:20344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638781.672545:0:20344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638781.672554:0:20344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638781.672565:0:20344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638781.672587:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638781.672652:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.672694:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581300 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.674112:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183703936 00000100:00100000:1.0:1788638781.674123:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183703936 00000100:00100000:1.0:1788638781.674175:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788638781.674186:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:20344:x1875523183703936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638781.674201:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638781.674217:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c1b2 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.674242:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.674253:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.674274:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309800, rc 0) 00000100:00100000:1.0:1788638781.674356:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183703936:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.674363:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788638781.679876:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183703936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638781.679907:0:20344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.679923:0:20344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638781.687514:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788638781.692151:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638781.692475:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788638781.692519:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788638781.692581:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788638781.692621:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788638781.692658:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788638781.692719:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788638781.692757:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788638781.692821:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788638781.692893:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788638781.692902:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788638781.692998:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638781.693067:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.693110:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.695378:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704064 00000100:00100000:1.0:1788638781.695392:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704064 00000100:00100000:1.0:1788638781.695453:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788638781.695463:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638781.695809:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704064:12345-0@lo:501:mount.lustre.0 Request processed in 346us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.695818:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788638781.696059:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638781.696104:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638781.696148:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.696188:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638781.696543:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704192 00000100:00100000:2.0:1788638781.696556:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704192 00000100:00100000:2.0:1788638781.696590:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788638781.696599:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638781.696767:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704192:12345-0@lo:503:mount.lustre.0 Request processed in 169us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638781.696774:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788638781.697341:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704192:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788638781.702032:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638781.702138:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638781.702217:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.702266:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581780 going to sleep for 11 seconds 00000100:00100000:0.0:1788638781.702559:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704320 00000100:00100000:0.0:1788638781.702567:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704320 00000100:00100000:0.0:1788638781.702626:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788638781.702635:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638781.702880:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704320:12345-0@lo:502:mount.lustre.0 Request processed in 245us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638781.702888:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788638781.703138:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638781.703388:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788638781.703440:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788638781.703489:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788638781.703528:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788638781.703561:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788638781.703619:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788638781.703656:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788638781.703693:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788638781.703735:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638781.703814:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.703851:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386723480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638781.705748:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704448 00000100:00100000:0.0:1788638781.705759:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704448 00000100:00100000:0.0:1788638781.705826:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788638781.705836:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638781.706080:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704448:12345-0@lo:502:mount.lustre.0 Request processed in 245us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638781.706088:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788638781.708850:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638781.709049:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788638781.709066:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788638781.711152:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638781.711164:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711167:0:20350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788638781.711174:0:20350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bd185000 00000020:00000080:1.0:1788638781.711177:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638781.711184:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638781.711186:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711187:0:20350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788638781.711190:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638781.711193:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711194:0:20350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788638781.711197:0:20350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bd185000 00000020:00000080:1.0:1788638781.711199:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638781.711251:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638781.711255:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711256:0:20350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788638781.711259:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638781.711261:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711270:0:20350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788638781.711275:0:20350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73bd185000 00000020:00000080:1.0:1788638781.711277:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638781.711316:0:20350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638781.711320:0:20350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638781.711321:0:20350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788638781.711324:0:20350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788638781.711693:0:20344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788638781.711729:0:20344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638781.711752:0:20344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.711763:0:20344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638781.711828:0:20344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788638781.711831:0:20344:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73bd185000 10000000:01000000:3.0:1788638781.711834:0:20344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73bd185000 10000000:01000000:3.0:1788638781.711845:0:20344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638781.711850:0:20344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bd185000 from 1 10000000:01000000:3.0:1788638781.711853:0:20344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788638781.711897:0:20344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.711906:0:20344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.711916:0:20344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.711950:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638781.712015:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.712056:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704576 00000100:00100000:3.0:1788638781.712063:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704576 00000100:00100000:3.0:1788638781.712104:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788638781.712113:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183704576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638781.712125:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638781.712137:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2c1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c1c0 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.712161:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1c0 expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.712173:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1c0 expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.712182:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc200, rc 0) 00000100:00100000:3.0:1788638781.712213:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704576:12345-0@lo:101:mount.lustre.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638781.712227:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788638781.712273:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638781.712293:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638781.712306:0:20344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1c7 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.712314:0:20344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c1c7 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638781.714778:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788638781.716881:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638781.717202:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788638781.717248:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788638781.717285:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788638781.717345:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788638781.717386:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788638781.717435:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788638781.717470:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788638781.717503:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788638781.717549:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788638781.717581:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788638781.717613:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788638781.717694:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788638781.717743:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788638781.717774:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788638781.717856:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788638781.717894:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788638781.717929:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788638781.717976:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788638781.718014:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788638781.718059:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788638781.718103:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788638781.718135:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788638781.718167:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788638781.718216:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788638781.718254:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788638781.718290:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788638781.718339:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788638781.718391:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788638781.718426:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788638781.718473:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788638781.718509:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788638781.718544:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788638781.718582:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788638781.718633:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788638781.718671:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788638781.727478:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788638781.727599:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788638781.727640:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788638781.727701:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788638781.727754:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788638781.727894:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788638781.727903:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788638781.728097:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638781.728163:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.728207:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638781.731540:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704704 00000100:00100000:2.0:1788638781.731555:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704704 00000100:00100000:2.0:1788638781.731614:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788638781.731626:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638781.734223:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704704:12345-0@lo:501:mount.lustre.0 Request processed in 2592us (6052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638781.734237:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788638781.735138:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638781.735198:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638781.735257:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.735297:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638781.736584:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704832 00000100:00100000:2.0:1788638781.736595:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704832 00000100:00100000:2.0:1788638781.736648:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788638781.736658:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638781.736896:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704832:12345-0@lo:503:mount.lustre.0 Request processed in 239us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638781.736905:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788638781.737079:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788638781.737843:0:20344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638781.737930:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638781.740316:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.743431:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638781.746042:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183704960 00000100:00100000:2.0:1788638781.746054:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183704960 00000100:00100000:3.0:1788638781.748514:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788638781.748527:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638781.748848:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183704960:12345-0@lo:502:mount.lustre.0 Request processed in 322us (8534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638781.748856:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788638781.748915:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183704960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638781.749566:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788638781.749622:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788638781.749658:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788638781.749704:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788638781.749751:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788638781.749840:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788638781.749880:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788638781.749915:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788638781.750489:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788638781.750534:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788638781.750568:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788638781.750619:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788638781.750658:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788638781.750694:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788638781.750761:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788638781.751232:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788638781.751266:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788638781.751328:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788638781.751365:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788638781.751397:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788638781.751440:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788638781.751472:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788638781.751502:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788638781.751546:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788638781.751580:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788638781.751617:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788638781.751684:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788638781.751743:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788638781.752372:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788638781.752445:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788638781.752484:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788638781.752540:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788638781.752574:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788638781.752626:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788638781.752663:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788638781.752724:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788638781.752763:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788638781.752838:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788638781.752891:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788638781.752929:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788638781.753056:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183705088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638781.753129:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.753165:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738802a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638781.753263:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705088 00000100:00100000:2.0:1788638781.753271:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705088 00000100:00100000:2.0:1788638781.753321:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788638781.753331:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183705088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638781.753537:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183705088:12345-0@lo:502:mount.lustre.0 Request processed in 207us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638781.753544:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788638781.755511:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183705088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638781.755644:0:20344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788638781.755659:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788638781.759696:0:20355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788638781.759724:0:20355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c72821119c0) 00000020:00000080:3.0:1788638781.759755:0:20355:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788638781.759893:0:20355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bd185000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788638781.759898:0:20355:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bd185000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788638781.759901:0:20355:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bd185000 3 00010000:00080000:3.0:1788638781.759944:0:20355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7384db4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.134@tcp at head 00010000:00010000:3.0:1788638781.761546:0:20355:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788638781.762555:0:20355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788638781.762595:0:20355:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788638781.762607:0:20355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa0b1f1e3b4b2c1d5 00000100:00080000:3.0:1788638781.762617:0:20355:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788638781.762623:0:20355:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7384db4000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638781.762659:0:20355:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7c44380 x1875523183705216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638781.762687:0:20355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788638781.763071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638781.763075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788638781.763078:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638781.763083:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1788638781.763088:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788638781.763092:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7387025000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638781.763108:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73ad30d500 x1875523183705472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638781.763169:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183705600:0@lo:400:kworker.0 00000100:00100000:1.0:1788638781.763234:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638781.763272:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638781.763279:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183705344:0@lo:400:kworker.0 00000100:00100000:1.0:1788638781.763305:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638781.763330:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183705728:0@lo:400:kworker.0 00000100:00100000:1.0:1788638781.763352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638781.763387:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705600 00000100:00100000:1.0:1788638781.763393:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705600 00000100:00100000:1.0:1788638781.763629:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705728 00000100:00100000:1.0:1788638781.763634:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705728 00000100:00100000:1.0:1788638781.763662:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638781.763671:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183705600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638781.763750:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183705600:12345-0@lo:400:kworker.0 Request processed in 80us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.763758:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638781.763773:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788638781.763801:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638781.763833:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183705728:12345-0@lo:400:kworker.0 Request processed in 54us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.763839:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638781.764018:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705344 00000100:00100000:3.0:1788638781.764022:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705344 00000100:00100000:2.0:1788638781.764097:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183705216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788638781.764132:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638781.764160:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183705472:0@lo:8:kworker.0 00000100:00100000:2.0:1788638781.764192:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638781.766533:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705216 00000100:00100000:1.0:1788638781.766544:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705216 00000100:00100000:1.0:1788638781.766582:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638781.766590:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183705216:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788638781.766631:0:18942:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1788638781.766665:0:18942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa0b1f1e3b4b2c1dc 00000004:00100000:1.0:1788638781.766681:0:18942:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788638781.766721:0:18942:0:(import.c:65:import_set_state_nolock()) ffff9c7398784800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638781.766815:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875523183705216:12345-0@lo:38:llog_process_th.0 Request processed in 224us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.766823:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788638781.766845:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638781.766849:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788638781.767091:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30c700 x1875523183705728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638781.767106:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183705728:0@lo:400:kworker.0 00010000:00080000:1.0:1788638781.767146:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30f800 x1875523183705600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638781.767164:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183705600:0@lo:400:kworker.0 00000040:00080000:0.0:1788638781.767399:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788638781.767580:0:20344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788638781.767604:0:20344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638781.767620:0:20344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1c7 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.767630:0:20344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2c1c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1c7 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638781.767672:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638781.767674:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638781.767676:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638781.767678:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638781.767679:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638781.767680:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638781.767682:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638781.767683:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638781.767685:0:20344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638781.767689:0:20344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788638781.767691:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638781.767692:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638781.767693:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638781.767695:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638781.767695:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638781.767697:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638781.767698:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638781.767699:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638781.767700:0:20344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638781.767728:0:20344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788638781.767744:0:20344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183705856:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788638781.767818:0:20344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638781.767843:0:20344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bbce0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.767865:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705856 00000100:00100000:1.0:1788638781.767876:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705856 00000100:00100000:1.0:1788638781.767905:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638781.767912:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:20344:x1875523183705856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638781.767945:0:18934:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788638781.767958:0:18934:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788638781.768717:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b7c44380 x1875523183705216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638781.768729:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788638781.768737:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788638781.768745:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788638781.768750:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788638781.768754:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7384db4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788638781.768760:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183705216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788638781.771089:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705472 00000100:00100000:3.0:1788638781.771100:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705472 00000100:00100000:3.0:1788638781.771140:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638781.771153:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1875523183705344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638781.771239:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1875523183705344:12345-0@lo:400:kworker.0 Request processed in 90us (7933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638781.771247:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638781.771264:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638781.771269:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183705472:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788638781.771317:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183705472:12345-0@lo:8:kworker.0 Request processed in 46us (7124us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788638781.771323:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638781.771398:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788638781.771433:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638781.771439:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638781.771443:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788638781.771447:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183705472:0@lo:8:kworker.0 20000000:01000000:1.0:1788638781.791219:0:18934:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788638781.791240:0:18934:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788638781.791331:0:18958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788638781.791337:0:18958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788638781.791361:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.791379:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.791388:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.791433:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.791450:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 19 pid: 18934 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.791466:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183705984:0@lo:104: 00000100:00100000:3.0:1788638781.791537:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.791591:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73981c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638781.791747:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183705984 00000100:00100000:1.0:1788638781.791756:0:18925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183705984 00000100:00100000:1.0:1788638781.791828:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638781.791836:0:18925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183705984:12345-0@lo:104: 00010000:00010000:1.0:1788638781.791850:0:18925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.791905:0:18925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638781.791912:0:18925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83477f13-c5f9-4c4e-acd2-08466075bc00+3:18958:x1875523183705984:12345-0@lo:104: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638781.791919:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638781.791922:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18958:1875523183705984:0@lo:104: 00010000:00010000:1.0:1788638781.791942:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638781.791950:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.791957:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638781.791961:0:18931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.791970:0:18931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638781.791978:0:18931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638781.791993:0:18931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638781.792025:0:18931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.792031:0:18931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638781.792053:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.792060:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5569200/0xa0b1f1e3b4b2c09a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c0a1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638781.792075:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638781.792077:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638781.792079:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638781.792098:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183706112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638781.792127:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638781.792230:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706112 00000100:00100000:3.0:1788638781.792234:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706112 00010000:00010000:3.0:1788638781.792253:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 20 pid: 18934 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.792288:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638781.792295:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+20:3294:x1875523183706112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638781.792301:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792305:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638781.792309:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 20 pid: 18934 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792319:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 20 pid: 18934 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792332:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5466800/0xa0b1f1e3b4b2c0a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c09a expref: 20 pid: 18934 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792345:0:18929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792353:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638781.792364:0:18929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012720264s 00010000:00010000:3.0:1788638781.792368:0:18929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792375:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792382:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792388:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792399:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638781.792403:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792411:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792424:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638781.792432:0:18958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638781.792433:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638781.792438:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638781.792444:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c1e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638781.792462:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3294:x1875523183706112:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638781.792468:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638781.792494:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183706112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638781.800431:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:20344:x1875523183705856:12345-0@lo:253:mount.lustre.0 Request processed in 32511us (32604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638781.800446:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638781.800577:0:20344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83477f13-c5f9-4c4e-acd2-08466075bc00:20344:1875523183705856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788638781.800593:0:20344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788638781.800597:0:20344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638781.800599:0:20344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638781.800600:0:20344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638781.800601:0:20344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638781.800603:0:20344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638781.800604:0:20344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638781.800606:0:20344:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638781.800608:0:20344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638781.800609:0:20344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638781.800627:0:20344:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638781.801250:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638781.801395:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638781.801757:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638781.802127:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638781.802279:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638781.802453:0:20344:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788638781.803283:0:20344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788638781.837317:0:20344:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788638781.837328:0:20344:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788638781.837363:0:20344:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638781.837422:0:20344:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638781.837440:0:20344:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788638781.837464:0:20344:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788638782.111947:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638783.135920:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788638783.137772:0:18939:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788638783.137779:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73bc901800 from 11 10000000:01000000:2.0:1788638783.137803:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788638783.137853:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638783.137866:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638783.137893:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638783.137919:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183706240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638783.137986:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638783.138037:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638783.138382:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706240 00000100:00100000:1.0:1788638783.138390:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706240 00000100:00100000:1.0:1788638783.138442:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788638783.138451:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf6e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183706240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638783.138465:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638783.138483:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2c1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c1ea expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638783.138508:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1ea expref: 19 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638783.138519:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1ea expref: 19 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638783.138529:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309200, rc 0) 00000100:00100000:1.0:1788638783.138579:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf6e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183706240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638783.138587:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788638783.138748:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183706240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638783.138765:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1f1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638783.138774:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c1f1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638783.138849:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183706368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788638783.138882:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638783.138906:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7385610000 going to sleep for 11 seconds 00000100:00100000:1.0:1788638783.138920:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706368 00000100:00100000:1.0:1788638783.138924:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706368 00000100:00100000:1.0:1788638783.138955:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788638783.138961:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183706368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788638783.138974:0:18934:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788638783.138988:0:18934:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788638783.138991:0:18934:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788638783.139057:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183706368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638783.139064:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788638783.139090:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183706368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788638783.139137:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788638783.139143:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1f1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638783.139152:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2c1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c1f1 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638783.298808:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788638783.298825:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788638784.160925:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638785.187285:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638785.248065:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183706496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638785.248141:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638785.248210:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706496 00000100:00100000:2.0:1788638785.248219:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706496 00000100:00100000:2.0:1788638785.248267:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638785.248274:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183706496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638785.248306:0:19631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788638785.248344:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183706496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638785.248350:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788638785.248367:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638785.248392:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788638785.248410:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183706496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638786.207936:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638786.598206:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788638786.786860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788638786.786868:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788638786.786872:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638786.786884:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7387025000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638786.786914:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73acdc8e00 x1875523183706880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638786.786976:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788638786.787039:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638786.787098:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638786.787104:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183706752:0@lo:400:kworker.0 00000100:00100000:0.0:1788638786.787130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638786.787162:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183706880:0@lo:8:kworker.0 00000100:00100000:0.0:1788638786.787190:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638786.787229:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707008 00000100:00100000:0.0:1788638786.787237:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707008 00000100:00100000:0.0:1788638786.787282:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638786.787292:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183707008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638786.787353:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183707008:12345-0@lo:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638786.787361:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638786.787383:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706752 00000100:00100000:0.0:1788638786.787386:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706752 00000100:00100000:0.0:1788638786.787424:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706880 00000100:00100000:0.0:1788638786.787428:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706880 00000100:00100000:0.0:1788638786.787444:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638786.787450:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183706752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638786.787487:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183706752:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638786.787492:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638786.787502:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638786.787506:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1875523183706880:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788638786.787526:0:19630:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1788638786.787552:0:19630:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2c1f8 00002000:00100000:0.0:1788638786.787566:0:19630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c73b4c09800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788638786.787570:0:19630:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788638786.787572:0:19630:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788638786.787981:0:19630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788638786.788005:0:19630:0:(import.c:65:import_set_state_nolock()) ffff9c73b4c0c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638786.788048:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183706880:12345-0@lo:8:kworker.0 Request processed in 540us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638786.788056:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788638786.788100:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdc8e00 x1875523183706880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788638786.788114:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788638786.788121:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788638786.788126:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788638786.788128:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7387025000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788638786.788140:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788638786.788152:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183706880:0@lo:8:kworker.0 00000004:00080000:0.0:1788638786.788194:0:18967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788638786.788209:0:18967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18967:1875523183707520:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788638786.788234:0:18967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638786.788250:0:18967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638786.788272:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183706752:0@lo:400:kworker.0 00010000:00080000:0.0:1788638786.788284:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdc8700 x1875523183707008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638786.788293:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788638786.788307:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638786.788312:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183707392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638786.788335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638786.788359:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707520 00000100:00100000:0.0:1788638786.788363:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707520 00000100:00100000:0.0:1788638786.788393:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638786.788399:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18967:x1875523183707520:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788638786.789819:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183707136:0@lo:400:kworker.0 00000100:00100000:3.0:1788638786.789875:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638786.789908:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788638786.789914:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183706624:0@lo:400:kworker.0 00000100:00100000:3.0:1788638786.789942:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638786.789970:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183707264:0@lo:400:kworker.0 00000100:00100000:3.0:1788638786.789993:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638786.790028:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707136 00000100:00100000:3.0:1788638786.790034:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707136 00000100:00100000:3.0:1788638786.790071:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707264 00000100:00100000:3.0:1788638786.790074:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707264 00000100:00100000:3.0:1788638786.790091:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638786.790098:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183707136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638786.790142:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183707136:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638786.790149:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638786.790166:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638786.790173:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183707264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638786.790201:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183707264:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638786.790207:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788638786.790258:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdca300 x1875523183707264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638786.790269:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183707264:0@lo:400:kworker.0 00010000:00080000:3.0:1788638786.790278:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdcb100 x1875523183707136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638786.790298:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183707136:0@lo:400:kworker.0 00000004:00080000:2.0:1788638786.790390:0:18966:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788638786.790859:0:18966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 549862075097ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788638786.790891:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707392 00000100:00100000:2.0:1788638786.790903:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707392 00000100:00100000:2.0:1788638786.790938:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638786.790946:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183707392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638786.790970:0:19631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638786.791020:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183707392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638786.791027:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788638786.791044:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638786.791048:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638786.791058:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183706624 00000100:00100000:2.0:1788638786.791061:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183706624 00000100:00100000:2.0:1788638786.791086:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638786.791092:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3291:x1875523183706624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638786.791125:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3291:x1875523183706624:12345-0@lo:400:kworker.0 Request processed in 33us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638786.791130:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638786.791166:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183706624:0@lo:400:kworker.0 00010000:00080000:0.0:1788638786.794804:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdc8e00 x1875523183707392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638786.794831:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183707392:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788638786.798880:0:19630:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788638786.798891:0:19630:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788638786.798895:0:19630:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:65) 00002000:00010000:0.0:1788638786.823299:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.823313:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.823340:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.823344:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.823351:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.823370:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.823381:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.823553:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.823575:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638786.823667:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638786.823685:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.823697:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638786.823702:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.823713:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.823742:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.823755:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2c1ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.823780:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.824111:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.824117:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824126:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.824129:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.824134:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824144:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824164:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824170:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824187:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.824197:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.824201:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824207:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.824211:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824219:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824230:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824238:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824251:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.824259:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.824260:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.824700:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.824706:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824715:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.824718:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.824723:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824732:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824740:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824746:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824760:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.824768:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.824772:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824779:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.824803:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824821:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824831:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824838:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c20d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.824851:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.824852:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.824854:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.825269:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.825275:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825283:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.825286:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.825291:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825299:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825307:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825320:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825333:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.825342:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.825345:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825351:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.825354:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825361:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825373:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.825380:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.825386:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.825391:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.825398:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.825401:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.825403:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.830926:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.830945:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.830962:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.830966:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.830973:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.830988:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.830999:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831007:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831028:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.831041:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.831046:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831053:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.831057:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831066:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831089:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831096:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c21b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.831114:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.831116:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.831118:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.833406:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.833418:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.833432:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.833437:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.833453:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.833467:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.833477:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.833485:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.833518:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638786.833901:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638786.833910:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.833920:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638786.833925:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.833936:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.833967:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.833978:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819895ed/0xa0b1f1e3b4b2c222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638786.833987:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.833997:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834014:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.834019:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.834024:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834030:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.834034:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.834035:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834036:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.834047:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834055:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834079:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638786.834153:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638786.834159:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834167:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638786.834171:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834180:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834194:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834202:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2c229 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834219:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.834222:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.834223:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.834499:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.834505:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834513:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.834522:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.834526:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834535:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834544:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834550:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.834566:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638786.834654:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638786.834660:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834699:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638786.834704:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834712:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834726:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834734:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2f46f3/0xa0b1f1e3b4b2c230 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.834755:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.834758:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.834762:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.835001:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.835008:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835016:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.835019:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.835023:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835032:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835039:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835054:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835072:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.835083:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.835088:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835096:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.835101:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835110:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835123:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835130:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835150:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.835152:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.835154:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788638786.835199:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788638786.835625:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.835630:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835638:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.835641:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.835645:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835654:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835662:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.835669:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.836622:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638786.837184:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.837192:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.837286:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.837290:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.837296:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.837320:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.837330:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.837343:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838217:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638786.838227:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838237:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.838241:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838251:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838286:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838294:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2c23e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838325:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.838329:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838336:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.838339:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838347:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838357:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.838364:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.838366:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.838368:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.838560:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638786.838567:0:19630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2c245 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.839037:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.839338:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.839345:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.839646:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.839651:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.839658:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.839670:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.839701:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.839709:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.839763:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638786.840249:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.840256:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.840264:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.840267:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.840271:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.840280:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.840288:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.840295:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842165:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638786.842177:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842201:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.842206:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842217:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842237:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842245:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046448853/0xa0b1f1e3b4b2c24c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842270:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.842274:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842280:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.842283:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842291:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842305:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.842318:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.842320:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.842322:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.844084:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638786.844097:0:19630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011593419/0xa0b1f1e3b4b2c253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638786.844753:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.844761:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.844774:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.844779:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.844807:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.844820:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.844831:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.844839:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.846515:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.846527:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.846539:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.846544:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.846555:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.846573:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.846583:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.846585:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.846586:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.848222:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638786.848235:0:19630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1e351c1/0xa0b1f1e3b4b2c25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638786.848888:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.848895:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.848907:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.849996:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.850008:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.850024:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.850035:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.850044:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.851037:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.851048:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.851058:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.851063:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.851085:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.851104:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.851115:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.851117:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.851119:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.853056:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638786.853070:0:19630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094075c4d/0xa0b1f1e3b4b2c261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.854310:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.854525:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.854536:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.854562:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.854567:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.854574:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.854588:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.854598:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.854605:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.857168:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638786.857747:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.857756:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.857772:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.857776:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.857810:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.857825:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.857846:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.857854:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858135:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638786.858142:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858151:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.858156:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858165:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858181:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858188:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c268 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858255:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.858259:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858266:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.858270:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858277:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858289:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.858298:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.858299:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.858301:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.861064:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638786.861079:0:19630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2c26f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638786.861748:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.861756:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861770:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.861776:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.861805:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861819:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861828:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861848:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861871:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.861887:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.861893:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861901:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.861905:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.861997:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862014:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862022:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830c21ae/0xa0b1f1e3b4b2c276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862040:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.862041:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.862043:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638786.862425:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638786.862437:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862445:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1788638786.862448:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638786.862453:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862461:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862470:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862477:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862493:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.862501:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.862505:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862512:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.862516:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862524:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862540:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862546:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2c27d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.862560:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.862562:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.862564:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.863211:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.864257:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.864268:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.864284:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.864289:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.864295:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.864321:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.864332:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.864355:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.864378:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.864468:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.864476:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.864486:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.864490:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.864499:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.864516:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.864524:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2c284 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.864558:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.864560:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.864562:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.864946:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.864953:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.865268:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.865272:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.865278:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.865289:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.865299:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.865319:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.865412:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638786.865561:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.865569:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.865577:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.865581:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.865603:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.865617:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.865625:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2c28b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.865710:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.865712:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.865714:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.866618:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.866627:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.866637:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.866640:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.866645:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.866654:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.866662:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.866668:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.866695:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.867585:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.867594:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.867606:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.867611:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.867621:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.867647:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.867655:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2c292 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.867671:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.867682:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.867685:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.868423:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.868433:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868449:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.868453:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.868459:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868470:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868479:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868487:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868511:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638786.868524:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638786.868528:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868535:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638786.868538:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868545:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868569:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868575:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2c299 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.868589:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.868591:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638786.868593:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.870664:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.870688:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.870703:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.870708:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.870714:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.870726:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.870737:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.870745:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.870795:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638786.871080:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638786.871087:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.871110:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638786.871115:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.871125:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.871143:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.871151:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2c2a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638786.871173:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.871176:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.871178:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.871388:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.871394:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871403:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.871406:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.871410:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871420:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871428:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871435:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871456:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638786.871480:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638786.871487:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.871494:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638786.871498:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.871506:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.871519:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.871537:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e39a0cd4/0xa0b1f1e3b4b2c2a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638786.871554:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.871557:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638786.871559:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.871910:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.871916:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871925:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.871932:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.871937:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871947:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871955:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871962:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.871972:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638786.872297:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.872302:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872310:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.872313:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.872317:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872326:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872335:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872346:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872367:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788638786.872611:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638786.872619:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872629:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.872633:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872642:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872657:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872665:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6a8e4f/0xa0b1f1e3b4b2c2ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872698:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638786.872702:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872708:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.872712:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872730:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872742:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872749:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000605a5039/0xa0b1f1e3b4b2c2b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.872764:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.872767:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.872769:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.872775:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.872805:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872815:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.872819:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.872823:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872832:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872840:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872846:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.872862:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638786.873228:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.873234:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873247:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.873249:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.873254:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873263:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873271:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873278:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873285:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788638786.873403:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638786.873410:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873418:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.873422:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873431:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873445:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873467:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc0d940f/0xa0b1f1e3b4b2c2bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873482:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638786.873486:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873491:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.873494:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873500:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873510:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873516:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032f4f4b8/0xa0b1f1e3b4b2c2c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.873541:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.873543:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.873545:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.873643:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.873649:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873656:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.873659:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.873663:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.873672:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.874234:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.874241:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.874258:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788638786.874283:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638786.874289:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.874306:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.874310:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.874318:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.874332:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.874339:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2c2ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.874356:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.874359:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.874361:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638786.874649:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.874654:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.874662:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.874666:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.874670:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.875749:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.875762:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.875769:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.876683:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638786.877303:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638786.877312:0:19630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.877326:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1788638786.877331:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638786.877336:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.877779:0:19630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.877810:0:19630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.877818:0:19630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638786.879598:0:19630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788638786.879620:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638786.879630:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879643:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.879648:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879659:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879706:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879715:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2c2d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879743:0:18931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638786.879747:0:18931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879754:0:18931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638786.879759:0:18931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879767:0:18931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879780:0:18931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879805:0:18931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2c2d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638786.879830:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.879835:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638786.879844:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788638786.880654:0:19630:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788638786.880764:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18967:x1875523183707520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92361us (92526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638786.880775:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788638786.887587:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638786.887600:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638786.889458:0:18967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18967:1875523183707520:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788638786.890425:0:18967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788638786.891397:0:18967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18967:1875523183707648:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788638786.891469:0:18967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638786.891527:0:18967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466840 going to sleep for 11 seconds 00000100:00100000:2.0:1788638786.891875:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707648 00000100:00100000:2.0:1788638786.891883:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707648 00000100:00100000:2.0:1788638786.891940:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638786.891951:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18967:x1875523183707648:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788638786.892000:0:19627:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788638786.898324:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18967:x1875523183707648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6367us (6848us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788638786.898338:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638786.898737:0:18967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18967:1875523183707648:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788638786.898754:0:18967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:3.0:1788638787.232166:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788638787.381448:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788638787.381479:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:02000400:0.0:1788638787.917944:0:20699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788638788.256018:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638789.282214:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638789.923520:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638789.923639:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272640 00000100:00100000:1.0:1788638789.923674:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272640 00000100:00100000:1.0:1788638789.923729:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:1.0:1788638789.923736:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2363:x1875523174272640:12345-192.168.203.34@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788638789.923765:0:18937:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b1c47af9-dda1-43c0-a01f-d15aafaa43be@192.168.203.34@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:3.0:1788638789.923998:0:18937:0:(genops.c:1385:class_connect()) connect: client b1c47af9-dda1-43c0-a01f-d15aafaa43be, cookie 0xa0b1f1e3b4b2c2df 00000100:00080000:3.0:1788638789.924146:0:18937:0:(import.c:65:import_set_state_nolock()) ffff9c73bd180800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638789.924216:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+5:2363:x1875523174272640:12345-192.168.203.34@tcp:250:mount.lustre.0 Request processed in 477us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638789.924224:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:2.0:1788638789.928127:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638789.928219:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272768 00000100:00100000:1.0:1788638789.928229:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272768 00000100:00100000:1.0:1788638789.928283:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:1.0:1788638789.928293:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738f698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+5:16744:x1875523174272768:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638789.928310:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638789.928328:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2c2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435347 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638789.928359:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2c2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435347 expref: 6 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638789.928370:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2c2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435347 expref: 6 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638789.928378:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638789.928435:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738f698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+6:16744:x1875523174272768:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 143us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638789.928442:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:0.0:1788638789.936186:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638789.936272:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174272896 00000100:00100000:3.0:1788638789.936283:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174272896 00000100:00100000:3.0:1788638789.936358:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:3.0:1788638789.936369:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+6:16744:x1875523174272896:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788638789.937322:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+6:16744:x1875523174272896:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 949us (1139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638789.937333:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:3.0:1788638789.944589:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638789.944807:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273024 00000100:00100000:2.0:1788638789.944817:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273024 00000100:00100000:2.0:1788638789.944877:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:2.0:1788638789.944886:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+6:16744:x1875523174273024:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638789.944901:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638789.944927:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01c000/0xa0b1f1e3b4b2c2ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a143534e expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638789.944958:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01c000/0xa0b1f1e3b4b2c2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143534e expref: 7 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638789.944986:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01c000/0xa0b1f1e3b4b2c2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143534e expref: 7 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638789.944996:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c000, rc 0) 00000100:00100000:2.0:1788638789.945055:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+7:16744:x1875523174273024:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 171us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638789.945063:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:2.0:1788638789.949583:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638789.949714:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273152 00000100:00100000:3.0:1788638789.949725:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273152 00000100:00100000:3.0:1788638789.949819:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:3.0:1788638789.949829:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+7:16744:x1875523174273152:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788638789.950399:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16744:x1875523174273152:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 568us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638789.950407:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:0.0:1788638789.957822:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638789.957906:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273280 00000100:00100000:2.0:1788638789.957926:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273280 00000100:00100000:2.0:1788638789.957985:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:2.0:1788638789.957995:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16744:x1875523174273280:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788638789.958580:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16744:x1875523174273280:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 584us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638789.958589:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:0.0:1788638789.971548:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638789.974045:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273408 00000100:00100000:1.0:1788638789.974061:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273408 00000100:00100000:1.0:1788638789.974131:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:1.0:1788638789.974142:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16763:x1875523174273408:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638789.974696:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16763:x1875523174273408:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 554us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638789.974712:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:0.0:1788638790.000500:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638790.000650:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273536 00000100:00100000:3.0:1788638790.000670:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273536 00000100:00100000:3.0:1788638790.000729:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:3.0:1788638790.000740:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16763:x1875523174273536:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788638790.001401:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16763:x1875523174273536:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 659us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.001411:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:0.0:1788638790.013217:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638790.013566:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273664 00000100:00100000:2.0:1788638790.013576:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273664 00000100:00100000:2.0:1788638790.013639:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:2.0:1788638790.013649:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+8:16744:x1875523174273664:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638790.013675:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638790.013692:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d200/0xa0b1f1e3b4b2c2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435378 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.013718:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d200/0xa0b1f1e3b4b2c2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435378 expref: 9 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.013749:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d200/0xa0b1f1e3b4b2c2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435378 expref: 9 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.013759:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:2.0:1788638790.013842:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+9:16744:x1875523174273664:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 194us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638790.013848:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:0.0:1788638790.021628:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638790.022671:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273792 00000100:00100000:3.0:1788638790.022684:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273792 00000100:00100000:3.0:1788638790.022751:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:3.0:1788638790.022761:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+9:16744:x1875523174273792:12345-192.168.203.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788638790.022819:0:18937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788638790.022843:0:18937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788638790.022848:0:18937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788638790.022851:0:18937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788638790.022853:0:18937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788638790.026157:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+9:16744:x1875523174273792:12345-192.168.203.34@tcp:256:mount.lustre.0 Request processed in 3387us (4538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.026172:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:0.0:1788638790.031334:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.031482:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174273920 00000100:00100000:1.0:1788638790.031493:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174273920 00000100:00100000:1.0:1788638790.031546:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:1.0:1788638790.031557:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+9:16744:x1875523174273920:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638790.031573:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638790.031591:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a143537f expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638790.031807:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 10 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638790.031823:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 10 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638790.031832:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309000, rc 0) 00000100:00100000:1.0:1788638790.031888:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16744:x1875523174273920:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 332us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.031895:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:0.0:1788638790.044835:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638790.046433:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274048 00000100:00100000:3.0:1788638790.046457:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274048 00000100:00100000:3.0:1788638790.046529:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:3.0:1788638790.046540:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16744:x1875523174274048:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788638790.046894:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16744:x1875523174274048:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 355us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.046903:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:0.0:1788638790.049061:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.049152:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274176 00000100:00100000:1.0:1788638790.049161:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274176 00000100:00100000:1.0:1788638790.049211:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:1.0:1788638790.049220:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16744:x1875523174274176:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788638790.049981:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16744:x1875523174274176:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 759us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.049991:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:0.0:1788638790.060727:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638790.061602:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274304 00000100:00100000:2.0:1788638790.061614:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274304 00000100:00100000:2.0:1788638790.061683:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:2.0:1788638790.061693:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16767:x1875523174274304:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638790.062018:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16767:x1875523174274304:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 326us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638790.062027:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:0.0:1788638790.065466:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.065560:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274432 00000100:00100000:1.0:1788638790.065569:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274432 00000100:00100000:1.0:1788638790.065632:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:1.0:1788638790.065642:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16767:x1875523174274432:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638790.065938:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16767:x1875523174274432:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 296us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.065947:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:0.0:1788638790.071250:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638790.071642:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274560 00000100:00100000:3.0:1788638790.071662:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274560 00000100:00100000:3.0:1788638790.071712:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638790.071722:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2363:x1875523174274560:12345-192.168.203.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788638790.071750:0:18944:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f354e72a-acd9-4a93-bd80-84ba26e24288@192.168.203.34@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1788638790.071839:0:18944:0:(genops.c:1385:class_connect()) connect: client f354e72a-acd9-4a93-bd80-84ba26e24288, cookie 0xa0b1f1e3b4b2c302 00000004:00100000:3.0:1788638790.071871:0:18944:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1788638790.071877:0:18944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788638790.119296:0:18944:0:(import.c:65:import_set_state_nolock()) ffff9c73bd185800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638790.119379:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2363:x1875523174274560:12345-192.168.203.34@tcp:38:mount.lustre.0 Request processed in 47655us (48146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.119390:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638790.124608:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638790.124669:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.127036:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274816 00000100:00100000:1.0:1788638790.127051:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274816 00000100:00100000:1.0:1788638790.127137:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274688 00000100:00100000:1.0:1788638790.127141:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274688 00000100:00100000:1.0:1788638790.127161:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:1.0:1788638790.127170:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+7:16744:x1875523174274816:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788638790.127212:0:18943:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788638790.127363:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+7:16744:x1875523174274816:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 193us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.127370:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:1.0:1788638790.127388:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:1.0:1788638790.127394:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+6:0:x1875523174274688:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788638790.127406:0:18943:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788638790.127428:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+6:0:x1875523174274688:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 34us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.127435:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00080000:2.0:1788638790.127553:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638790.132601:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638790.132735:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174274944 00000100:00100000:0.0:1788638790.132746:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174274944 00000100:00100000:0.0:1788638790.132852:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:0.0:1788638790.132862:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16744:x1875523174274944:12345-192.168.203.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788638790.132945:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16744:x1875523174274944:12345-192.168.203.34@tcp:40:mount.lustre.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638790.132953:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:1.0:1788638790.135524:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.135564:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638790.135601:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638790.135680:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275328 00000100:00100000:0.0:1788638790.135690:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275328 00000100:00100000:0.0:1788638790.135746:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638790.135756:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16744:x1875523174275328:12345-192.168.203.34@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788638790.138012:0:18945:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2150us 00000100:00100000:2.0:1788638790.139056:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275072 00000100:00100000:2.0:1788638790.139066:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275072 00000100:00100000:2.0:1788638790.139101:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275200 00000100:00100000:2.0:1788638790.139105:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275200 00000100:00100000:2.0:1788638790.139126:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638790.139135:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1875523174275072:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788638790.139165:0:20262:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f354e72a-acd9-4a93-bd80-84ba26e24288@192.168.203.34@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788638790.139194:0:20262:0:(genops.c:1385:class_connect()) connect: client f354e72a-acd9-4a93-bd80-84ba26e24288, cookie 0xa0b1f1e3b4b2c309 00002000:00100000:2.0:1788638790.139205:0:20262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f354e72a-acd9-4a93-bd80-84ba26e24288/ffff9c728183b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788638790.139364:0:20262:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788638790.139696:0:20262:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788638790.140092:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638790.140100:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1875523174275200:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638790.140120:0:19630:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f354e72a-acd9-4a93-bd80-84ba26e24288@192.168.203.34@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1788638790.140142:0:19630:0:(genops.c:1385:class_connect()) connect: client f354e72a-acd9-4a93-bd80-84ba26e24288, cookie 0xa0b1f1e3b4b2c310 00002000:00100000:3.0:1788638790.140149:0:19630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f354e72a-acd9-4a93-bd80-84ba26e24288/ffff9c73bd184800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638790.140163:0:19630:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638790.140404:0:19630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788638790.140449:0:19630:0:(import.c:65:import_set_state_nolock()) ffff9c73843b2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638790.140528:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2363:x1875523174275200:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 426us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.140541:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00080000:2.0:1788638790.141416:0:20262:0:(import.c:65:import_set_state_nolock()) ffff9c728183e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638790.142181:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2363:x1875523174275072:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 3041us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638790.142192:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000004:00200000:1.0:1788638790.154574:0:18945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788638790.154693:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16744:x1875523174275328:12345-192.168.203.34@tcp:33:mount.lustre.0 Request processed in 18933us (19172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638790.154709:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00010000:00010000:0.0:1788638790.304276:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638790.368072:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183707776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638790.368147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638790.368274:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707776 00000100:00100000:3.0:1788638790.368282:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707776 00000100:00100000:3.0:1788638790.368354:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638790.368363:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183707776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638790.368383:0:19631:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1788638790.369534:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638790.379979:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183707776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11607us (11822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638790.379994:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638790.381315:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638790.381438:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275456 00000100:00100000:2.0:1788638790.381449:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275456 00000100:00100000:2.0:1788638790.381509:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638790.381519:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16788:x1875523174275456:12345-192.168.203.34@tcp:101:mkdir.0 00010000:00010000:2.0:1788638790.381539:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638790.381564:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2c317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14353a9 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381628:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381643:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381668:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638790.381705:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638790.381708:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638790.381746:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381847:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2c317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353a9 expref: 8 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381868:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353a9 expref: 7 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638790.381876:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:2.0:1788638790.381878:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638790.381882:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ce00, rc 0) 00000100:00100000:2.0:1788638790.382046:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+7:16788:x1875523174275456:12345-192.168.203.34@tcp:101:mkdir.0 Request processed in 526us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638790.382053:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638790.383615:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183707776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788638791.328218:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638791.904052:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183707904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638791.904123:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638791.904367:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183707904 00000100:00100000:0.0:1788638791.904375:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183707904 00000100:00100000:0.0:1788638791.904440:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638791.904450:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183707904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638791.904470:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638791.904520:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183707904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638791.904527:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638791.904745:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183708288:0@lo:400:kworker.0 00000100:00100000:1.0:1788638791.904779:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638791.904826:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638791.904833:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183708160:0@lo:400:kworker.0 00000100:00100000:1.0:1788638791.904857:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638791.904993:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183708032:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905028:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638791.905064:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183708544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638791.905104:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638791.905109:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183708416:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905129:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638791.905166:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708288 00000100:00100000:3.0:1788638791.905171:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708288 00000100:00100000:3.0:1788638791.905194:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708544 00000100:00100000:3.0:1788638791.905197:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708544 00000100:00100000:3.0:1788638791.905216:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708416 00000100:00100000:3.0:1788638791.905219:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708416 00000100:00100000:3.0:1788638791.905233:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638791.905239:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183708288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905283:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183708288:12345-0@lo:400:kworker.0 Request processed in 43us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638791.905303:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638791.905319:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788638791.905324:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183708544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905355:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183708544:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638791.905361:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788638791.905372:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638791.905378:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183708416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905403:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183708416:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638791.905410:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638791.905450:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183708416:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905461:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183708544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905491:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183708288:0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905508:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708160 00000100:00100000:3.0:1788638791.905510:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708160 00000100:00100000:3.0:1788638791.905537:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638791.905543:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638791.905578:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183708160:12345-0@lo:400:kworker.0 Request processed in 35us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638791.905584:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638791.905613:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183708160:0@lo:400:kworker.0 00000100:00080000:2.0:1788638791.905871:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638791.905877:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638791.905897:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788638791.905915:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183707904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638791.906692:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708032 00000100:00100000:1.0:1788638791.906710:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708032 00000100:00100000:1.0:1788638791.906760:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638791.906768:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3292:x1875523183708032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638791.906863:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3292:x1875523183708032:12345-0@lo:400:kworker.0 Request processed in 96us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638791.906871:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788638791.907026:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83477f13-c5f9-4c4e-acd2-08466075bc00:3292:1875523183708032:0@lo:400:kworker.0 00010000:00010000:0.0:1788638792.352127:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788638792.485265:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f354e72a-acd9-4a93-bd80-84ba26e24288 00000100:00100000:1.0:1788638792.618420:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638792.618606:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275584 00000100:00100000:3.0:1788638792.618617:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275584 00000100:00100000:3.0:1788638792.618702:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638792.618713:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:16841:x1875523174275584:12345-192.168.203.34@tcp:41:lfs.0 00000004:00000024:3.0:1788638792.618756:0:18944:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788638792.619154:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638792.619268:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:16841:x1875523174275584:12345-192.168.203.34@tcp:41:lfs.0 Request processed in 555us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638792.619277:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638792.626577:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638792.626650:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275712 00000100:00100000:0.0:1788638792.626659:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275712 00000100:00100000:0.0:1788638792.626737:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638792.626747:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16841:x1875523174275712:12345-192.168.203.34@tcp:13:lfs.0 00002000:00000024:0.0:1788638792.626809:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788638792.626902:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f354e72a-acd9-4a93-bd80-84ba26e24288+6:16841:x1875523174275712:12345-192.168.203.34@tcp:13:lfs.0 Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638792.626911:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00080000:2.0:1788638792.627315:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638792.631448:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638792.631690:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275840 00000100:00100000:0.0:1788638792.631700:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275840 00000100:00100000:0.0:1788638792.631771:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:0.0:1788638792.631806:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f354e72a-acd9-4a93-bd80-84ba26e24288+5:16841:x1875523174275840:12345-192.168.203.34@tcp:13:lfs.0 00002000:00000024:0.0:1788638792.631845:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788638792.631879:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638792.631932:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f354e72a-acd9-4a93-bd80-84ba26e24288+5:16841:x1875523174275840:12345-192.168.203.34@tcp:13:lfs.0 Request processed in 153us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638792.631956:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:1.0:1788638792.861405:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.863269:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174275968 00000100:00100000:2.0:1788638792.863282:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174275968 00000100:00100000:2.0:1788638792.863351:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:2.0:1788638792.863361:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+10:16872:x1875523174275968:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638792.863375:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638792.863407:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01c600/0xa0b1f1e3b4b2c325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14353b0 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.863437:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01c600/0xa0b1f1e3b4b2c325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353b0 expref: 11 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.863448:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01c600/0xa0b1f1e3b4b2c325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353b0 expref: 11 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.863457:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:2.0:1788638792.863561:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174275968:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 200us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.863568:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:1.0:1788638792.878362:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.878460:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276096 00000100:00100000:2.0:1788638792.878471:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276096 00000100:00100000:2.0:1788638792.878548:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638792.878558:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174276096:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788638792.878906:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174276096:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 348us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.878914:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:0.0:1788638792.889079:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638792.889284:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276224 00000100:00100000:1.0:1788638792.889293:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276224 00000100:00100000:1.0:1788638792.889350:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:1.0:1788638792.889360:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174276224:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788638792.890642:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174276224:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 1260us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638792.890656:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:1.0:1788638792.908760:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638792.909082:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276352 00000100:00100000:0.0:1788638792.909094:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276352 00000100:00100000:0.0:1788638792.909154:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:0.0:1788638792.909165:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16880:x1875523174276352:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638792.909461:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16880:x1875523174276352:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 297us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638792.909470:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:0.0:1788638792.939897:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638792.940024:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276480 00000100:00100000:1.0:1788638792.940034:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276480 00000100:00100000:1.0:1788638792.940093:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:1.0:1788638792.940102:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16880:x1875523174276480:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638792.940398:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16880:x1875523174276480:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 295us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638792.940407:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:1.0:1788638792.948501:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.948605:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276608 00000100:00100000:2.0:1788638792.948615:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276608 00000100:00100000:2.0:1788638792.948677:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:2.0:1788638792.948687:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16872:x1875523174276608:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638792.948703:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638792.948720:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2c32c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14353da expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.948765:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2c32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353da expref: 12 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.948776:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01c800/0xa0b1f1e3b4b2c32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353da expref: 12 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638792.948815:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c800, rc 0) 00000100:00100000:2.0:1788638792.948887:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16872:x1875523174276608:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 200us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.948894:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:2.0:1788638792.951715:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638792.951864:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276736 00000100:00100000:0.0:1788638792.951876:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276736 00000100:00100000:0.0:1788638792.951926:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:0.0:1788638792.951935:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16872:x1875523174276736:12345-192.168.203.34@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788638792.951960:0:18936:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788638792.951982:0:18936:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788638792.951987:0:18936:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788638792.951990:0:18936:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788638792.951992:0:18936:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788638792.953670:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16872:x1875523174276736:12345-192.168.203.34@tcp:256:mount.lustre.0 Request processed in 1726us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.953684:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:1.0:1788638792.957284:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638792.957682:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276864 00000100:00100000:3.0:1788638792.957692:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276864 00000100:00100000:3.0:1788638792.957831:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:3.0:1788638792.957850:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16872:x1875523174276864:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788638792.957868:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638792.957888:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14353e1 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638792.957917:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638792.957928:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638792.957938:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fda00, rc 0) 00000100:00100000:3.0:1788638792.957989:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16872:x1875523174276864:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 149us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638792.957996:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:1.0:1788638792.963957:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.964051:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174276992 00000100:00100000:2.0:1788638792.964061:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174276992 00000100:00100000:2.0:1788638792.964129:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:2.0:1788638792.964139:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16872:x1875523174276992:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788638792.964821:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16872:x1875523174276992:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 679us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.964830:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:0.0:1788638792.968277:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638792.968374:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277120 00000100:00100000:3.0:1788638792.968398:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277120 00000100:00100000:3.0:1788638792.968860:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:3.0:1788638792.968872:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16872:x1875523174277120:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788638792.969090:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16872:x1875523174277120:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 219us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638792.969098:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:1.0:1788638792.973241:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.973492:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277248 00000100:00100000:2.0:1788638792.973503:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277248 00000100:00100000:2.0:1788638792.973559:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:2.0:1788638792.973569:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16883:x1875523174277248:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638792.974000:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16883:x1875523174277248:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 430us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.974009:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:2.0:1788638792.981072:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638792.981960:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277376 00000100:00100000:3.0:1788638792.981970:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277376 00000100:00100000:3.0:1788638792.982027:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:3.0:1788638792.982036:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16883:x1875523174277376:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788638792.982305:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16883:x1875523174277376:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 268us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638792.982313:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:0.0:1788638792.986959:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.987126:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277504 00000100:00100000:2.0:1788638792.987136:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277504 00000100:00100000:2.0:1788638792.987184:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:2.0:1788638792.987192:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1875523174277504:12345-192.168.203.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788638792.987220:0:18943:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef@192.168.203.34@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1788638792.987259:0:18943:0:(genops.c:1385:class_connect()) connect: client 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef, cookie 0xa0b1f1e3b4b2c33a 00000004:00100000:2.0:1788638792.987288:0:18943:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788638792.987393:0:18943:0:(import.c:65:import_set_state_nolock()) ffff9c728183a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638792.987453:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2363:x1875523174277504:12345-192.168.203.34@tcp:38:mount.lustre.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.987462:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638792.995227:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638792.995264:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638792.995405:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277760 00000100:00100000:2.0:1788638792.995416:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277760 00000100:00100000:2.0:1788638792.995489:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277632 00000100:00100000:2.0:1788638792.995493:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277632 00000100:00100000:2.0:1788638792.995510:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:2.0:1788638792.995520:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+7:16872:x1875523174277760:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788638792.995565:0:18943:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788638792.995692:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638792.998108:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+7:16872:x1875523174277760:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 2577us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.998122:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:2.0:1788638792.998171:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:2.0:1788638792.998182:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:0:x1875523174277632:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788638792.998207:0:18943:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788638792.998240:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:0:x1875523174277632:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 63us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638792.998246:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638793.001456:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.001554:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174277888 00000100:00100000:0.0:1788638793.001563:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174277888 00000100:00100000:0.0:1788638793.001652:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638793.001662:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:16872:x1875523174277888:12345-192.168.203.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788638793.001752:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:16872:x1875523174277888:12345-192.168.203.34@tcp:40:mount.lustre.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638793.001759:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638793.008349:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008386:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008431:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008465:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008491:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008511:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008536:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638793.008564:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278016 00000100:00100000:0.0:1788638793.008572:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278016 00000100:00100000:3.0:1788638793.008689:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278400 00000100:00100000:3.0:1788638793.008695:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278400 00000100:00100000:3.0:1788638793.008709:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278528 00000100:00100000:3.0:1788638793.008711:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278528 00000100:00100000:3.0:1788638793.008730:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278656 00000100:00100000:3.0:1788638793.008732:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278656 00000100:00100000:3.0:1788638793.008748:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:3.0:1788638793.008756:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2367:x1875523174278528:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638793.008861:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2367:x1875523174278528:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 105us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638793.008868:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:3.0:1788638793.008886:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638793.008892:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2367:x1875523174278656:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638793.008936:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2367:x1875523174278656:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638793.008943:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638793.008960:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:3.0:1788638793.008965:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1875523174278016:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638793.008988:0:19627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef@192.168.203.34@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788638793.009019:0:19627:0:(genops.c:1385:class_connect()) connect: client 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef, cookie 0xa0b1f1e3b4b2c341 00002000:00100000:3.0:1788638793.009031:0:19627:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef/ffff9c73843b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638793.009042:0:19627:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638793.009135:0:19627:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638793.009160:0:19627:0:(import.c:65:import_set_state_nolock()) ffff9c73843b4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638793.009187:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2363:x1875523174278016:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 221us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638793.009194:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:3.0:1788638793.009208:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:3.0:1788638793.009212:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1875523174278400:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638793.009225:0:19627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef@192.168.203.34@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788638793.009241:0:19627:0:(genops.c:1385:class_connect()) connect: client 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef, cookie 0xa0b1f1e3b4b2c348 00002000:00100000:3.0:1788638793.009246:0:19627:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef/ffff9c73843b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638793.009251:0:19627:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638793.009426:0:19627:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788638793.009442:0:19627:0:(import.c:65:import_set_state_nolock()) ffff9c73843b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638793.009467:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2363:x1875523174278400:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 253us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638793.009480:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638793.009718:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278784 00000100:00100000:1.0:1788638793.009725:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278784 00000100:00100000:1.0:1788638793.009766:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638793.009773:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:16872:x1875523174278784:12345-192.168.203.34@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788638793.009988:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278272 00000100:00100000:0.0:1788638793.009993:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278272 00000100:00100000:0.0:1788638793.010025:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638793.010032:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2367:x1875523174278272:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638793.010064:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2367:x1875523174278272:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 33us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638793.010071:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000004:00200000:1.0:1788638793.010243:0:18946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788638793.010293:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:16872:x1875523174278784:12345-192.168.203.34@tcp:33:mount.lustre.0 Request processed in 519us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638793.010300:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638793.011721:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278144 00000100:00100000:1.0:1788638793.011744:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278144 00000100:00100000:1.0:1788638793.011810:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:1.0:1788638793.011819:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2367:x1875523174278144:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638793.011877:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2367:x1875523174278144:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 60us (3453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638793.011885:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:0.0:1788638793.198742:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638793.198948:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174278912 00000100:00100000:2.0:1788638793.198959:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174278912 00000100:00100000:2.0:1788638793.199018:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:2.0:1788638793.199030:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:16904:x1875523174278912:12345-192.168.203.34@tcp:101:mkdir.0 00010000:00010000:2.0:1788638793.199052:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638793.199073:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2c34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143540b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199138:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199152:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199165:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638793.199199:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638793.199203:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638793.199221:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199247:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2c34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 8 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199278:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 7 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638793.199286:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:2.0:1788638793.199289:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638793.199293:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638793.199351:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+7:16904:x1875523174278912:12345-192.168.203.34@tcp:101:mkdir.0 Request processed in 323us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638793.199358:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00010000:00010000:3.0:1788638793.377917:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788638793.492055:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f354e72a-acd9-4a93-bd80-84ba26e24288 00000001:00100000:1.0:1788638793.492082:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef 00010000:00010000:0.0:1788638794.401080:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638795.424022:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638795.489041:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183708672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638795.489111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638795.489201:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708672 00000100:00100000:2.0:1788638795.489209:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708672 00000100:00100000:2.0:1788638795.489272:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638795.489282:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183708672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638795.489316:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788638795.489364:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183708672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638795.489371:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788638795.489392:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638795.489426:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183708672:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788638795.615011:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef 00000001:00100000:3.0:1788638795.615027:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f354e72a-acd9-4a93-bd80-84ba26e24288 00000001:02000400:2.0:1788638796.212525:0:20906:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788638796.448388:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638796.834618:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788638797.024176:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638797.024286:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638797.024306:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183709184:0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.024371:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638797.027036:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183708928:0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.027099:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638797.027139:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638797.027147:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183709056:0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.027170:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638797.027213:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708928 00000100:00100000:2.0:1788638797.027221:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708928 00000100:00100000:2.0:1788638797.027272:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709056 00000100:00100000:2.0:1788638797.027275:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709056 00000100:00100000:2.0:1788638797.027299:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638797.027308:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183708928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.027360:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183708928:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638797.027368:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638797.027493:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638797.027503:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183709056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.027533:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183709056:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638797.027539:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788638797.027555:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638797.027558:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638797.027602:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183709056:0@lo:400:kworker.0 00000100:00100000:2.0:1788638797.027622:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183708928:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.028134:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709184 00000100:00100000:0.0:1788638797.028141:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709184 00000100:00100000:0.0:1788638797.028176:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638797.028184:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183709184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.028237:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183709184:12345-0@lo:400:kworker.0 Request processed in 53us (3865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638797.028243:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638797.028267:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183708800:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.029412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638797.029460:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638797.029474:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183709312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638797.029510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638797.029536:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709312 00000100:00100000:0.0:1788638797.029541:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709312 00000100:00100000:0.0:1788638797.029576:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638797.029583:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183709312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638797.029622:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638797.029657:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183709312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638797.029663:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638797.029705:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183709312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638797.029750:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183708800 00000100:00100000:0.0:1788638797.029842:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183708800 00000100:00100000:0.0:1788638797.030360:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788638797.030369:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3293:x1875523183708800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.030416:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3293:x1875523183708800:12345-0@lo:400:kworker.0 Request processed in 49us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638797.030423:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788638797.030457:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183708800:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.030521:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183709184:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.031163:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183709568:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.031207:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638797.031238:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638797.031243:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183709440:0@lo:400:kworker.0 00000100:00100000:0.0:1788638797.031267:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638797.031938:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709568 00000100:00100000:1.0:1788638797.031946:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709568 00000100:00100000:1.0:1788638797.031995:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709440 00000100:00100000:1.0:1788638797.031998:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709440 00000100:00100000:1.0:1788638797.032016:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638797.032023:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183709568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638797.032077:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183709568:12345-0@lo:400:kworker.0 Request processed in 55us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638797.032083:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638797.032098:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638797.032104:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183709440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638797.032128:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183709440:12345-0@lo:400:kworker.0 Request processed in 25us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638797.032134:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788638797.032152:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638797.032195:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788638797.032209:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183709568:0@lo:400:kworker.0 00010000:00010000:3.0:1788638797.476704:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788638797.638671:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 582b3c6d-c6fc-4265-b417-9d8f18b5c8ef 00000100:00100000:0.0:1788638798.084138:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638798.084188:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279168 00000100:00100000:0.0:1788638798.084190:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638798.084198:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279168 00000100:00100000:0.0:1788638798.084211:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638798.084233:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638798.084251:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638798.084254:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:3.0:1788638798.084265:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2366:x1875523174279168:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.084269:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638798.084289:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638798.084307:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279424 00000100:00100000:0.0:1788638798.084311:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279424 00000100:00100000:0.0:1788638798.084334:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279680 00000100:00100000:3.0:1788638798.084336:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2366:x1875523174279168:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.084336:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279680 00000100:00100000:3.0:1788638798.084343:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638798.084348:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279296 00000100:00100000:0.0:1788638798.084350:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279296 00000100:00100000:3.0:1788638798.084356:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279552 00000100:00100000:3.0:1788638798.084359:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279552 00000100:00100000:0.0:1788638798.084361:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279808 00000100:00100000:0.0:1788638798.084363:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279808 00000100:00100000:3.0:1788638798.084373:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:0.0:1788638798.084374:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638798.084378:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2366:x1875523174279552:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.084379:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2366:x1875523174279424:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.084416:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2366:x1875523174279424:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.084423:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:0.0:1788638798.084449:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638798.084455:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2366:x1875523174279680:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638798.086643:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2366:x1875523174279552:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 2251us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638798.086658:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00080000:3.0:1788638798.086696:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788638798.086701:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638798.086704:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638798.089231:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2366:x1875523174279680:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 4764us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.089247:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638798.089283:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638798.089296:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2366:x1875523174279296:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.089348:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2366:x1875523174279296:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 57us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.089354:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638798.089578:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638798.089588:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2366:x1875523174279808:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.089678:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2366:x1875523174279808:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 91us (5385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.089684:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638798.089711:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279040 00000100:00100000:0.0:1788638798.089718:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279040 00000100:00100000:0.0:1788638798.089763:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 104 00000100:00100000:0.0:1788638798.089770:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2366:x1875523174279040:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638798.089834:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2366:x1875523174279040:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 65us (5599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638798.089841:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 104 00010000:00010000:1.0:1788638798.498163:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638799.521523:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788638799.801283:0:21053:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1913a490 20000000:00000080:0.0:1788638799.801372:0:21053:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73b78a5800 uarg=0000000000000000 20000000:01000000:0.0:1788638799.801409:0:21053:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788638799.801414:0:21053:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788638799.801419:0:21053:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788638799.803260:0:21054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788638799.803537:0:21053:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788638799.811153:0:21053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788638799.811256:0:21053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811276:0:21053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811284:0:21053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 18 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811291:0:21053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811301:0:21053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 12 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811369:0:21053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811375:0:21053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811416:0:21053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 12 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811429:0:21053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 12 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.811445:0:21053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709696:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638799.811579:0:21053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 12 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811617:0:21053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 12 pid: 18934 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.811627:0:21053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709824:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638799.811661:0:21053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811670:0:21053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.811679:0:21053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709952:0@lo:104: 00000100:00100000:3.0:1788638799.811710:0:21053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638799.811750:0:21053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 18 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811759:0:21053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 18 pid: 18936 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.811767:0:21053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183710080:0@lo:104: 00000100:00100000:3.0:1788638799.811830:0:21053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638799.811860:0:21053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.811869:0:21053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 18 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.811878:0:21053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183710208:0@lo:104: 00000100:00100000:3.0:1788638799.811899:0:21053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638799.811914:0:21053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7393d940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638799.813494:0:18926:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788638799.813517:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183709952 00000100:00100000:1.0:1788638799.813526:0:18926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183709952 00000100:00100000:1.0:1788638799.813563:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710080 00000100:00100000:1.0:1788638799.813566:0:18926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710080 00000100:00100000:1.0:1788638799.813576:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710208 00000100:00100000:1.0:1788638799.813578:0:18926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710208 00000100:00100000:1.0:1788638799.813602:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638799.813619:0:18926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+5:21053:x1875523183709952:12345-0@lo:104: 00010000:00010000:1.0:1788638799.813634:0:18926:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.813717:0:18926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638799.813723:0:18926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+5:21053:x1875523183709952:12345-0@lo:104: Request processed in 114us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.813729:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638799.813747:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638799.813754:0:18926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+4:21053:x1875523183710080:12345-0@lo:104: 00010000:00010000:1.0:1788638799.813761:0:18926:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.813819:0:18926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788638799.813824:0:18926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+4:21053:x1875523183710080:12345-0@lo:104: Request processed in 72us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.813831:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638799.813843:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638799.813848:0:18926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7df7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+3:21053:x1875523183710208:12345-0@lo:104: 00010000:00010000:1.0:1788638799.813863:0:18926:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.813893:0:18926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788638799.813898:0:18926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7df7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83477f13-c5f9-4c4e-acd2-08466075bc00+3:21053:x1875523183710208:12345-0@lo:104: Request processed in 50us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.813904:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788638799.813958:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788638799.813964:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.813971:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638799.813976:0:18930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.813984:0:18930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638799.813991:0:18930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638799.813997:0:18930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788638799.814028:0:18930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814034:0:18930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638799.814052:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814058:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d400/0xa0b1f1e3b4b2c1b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c1b9 expref: -99 pid: 20344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814076:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788638799.814079:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814084:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638799.814086:0:18930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814092:0:18930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638799.814097:0:18930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638799.814102:0:18930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788638799.814115:0:18930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814120:0:18930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638799.814126:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814132:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01d600/0xa0b1f1e3b4b2c062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c069 expref: -99 pid: 19626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814139:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638799.814142:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814157:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638799.814160:0:18930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814924:0:18930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638799.814932:0:18930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638799.814937:0:18930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788638799.814955:0:18930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814962:0:18930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638799.814984:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.814991:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5466200/0xa0b1f1e3b4b2c015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2c01c expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.815006:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638799.815007:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638799.815009:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638799.815033:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183710464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638799.815078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638799.815119:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638799.815125:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183710336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638799.815160:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638799.815435:0:21053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709952:0@lo:104: 00000100:00100000:3.0:1788638799.815447:0:21053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183710080:0@lo:104: 00000100:00100000:3.0:1788638799.815455:0:21053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183710208:0@lo:104: 00000100:00100000:2.0:1788638799.815573:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183710592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638799.815833:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710464 00000100:00100000:1.0:1788638799.815839:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710464 00010000:00010000:1.0:1788638799.815866:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 19 pid: 18936 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638799.815891:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710336 00000100:00100000:1.0:1788638799.815894:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710336 00010000:00010000:1.0:1788638799.815906:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 20 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638799.815920:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638799.815927:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+20:3294:x1875523183710464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638799.815938:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638799.815944:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 20 pid: 18936 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.815953:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 20 pid: 18936 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.815969:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fc600/0xa0b1f1e3b4b2c069 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c062 expref: 20 pid: 18936 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.815984:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638799.816019:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3294:x1875523183710464:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.816025:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638799.816040:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638799.816046:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:3294:x1875523183710336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638799.816064:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638799.816069:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.816077:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.816086:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309800/0xa0b1f1e3b4b2c1b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c1b2 expref: 18 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.816094:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638799.816117:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:3294:x1875523183710336:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.816123:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638799.816281:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183710336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638799.816524:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638799.816611:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710592 00000100:00100000:2.0:1788638799.816622:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710592 00010000:00010000:2.0:1788638799.816639:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 17 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638799.816669:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638799.816676:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385332850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:3291:x1875523183710592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638799.816684:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638799.816688:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 17 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638799.816696:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 17 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638799.816708:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2c01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2c015 expref: 17 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638799.816717:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638799.816751:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385332850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:3291:x1875523183710592:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638799.816757:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638799.816833:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83477f13-c5f9-4c4e-acd2-08466075bc00:3291:1875523183710592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638799.817032:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183710464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638799.818010:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638799.824155:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638799.824224:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638799.824317:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174279936 00000100:00100000:1.0:1788638799.824326:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174279936 00010000:00010000:1.0:1788638799.824361:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 13 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638799.824398:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280064 00000100:00100000:1.0:1788638799.824400:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280064 00010000:00010000:1.0:1788638799.824412:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 14 pid: 18934 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638799.824425:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:1.0:1788638799.824433:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+14:2364:x1875523174279936:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638799.824462:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638799.824467:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 14 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824479:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 14 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824497:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638799.824539:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+14:2364:x1875523174279936:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.824545:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:1.0:1788638799.824563:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:1.0:1788638799.824570:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2364:x1875523174280064:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638799.824576:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638799.824581:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 13 pid: 18934 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824600:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 13 pid: 18934 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824611:0:18929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824620:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824635:0:18929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824652:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824659:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824666:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824671:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638799.824675:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824683:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824692:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638799.824701:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638799.824718:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2364:x1875523174280064:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 149us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638799.824729:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00010000:00010000:3.0:1788638799.825156:0:21053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fda00/0xa0b1f1e3b4b2c333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353e1 expref: 12 pid: 18937 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.825171:0:21053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709696:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638799.825181:0:21053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309000/0xa0b1f1e3b4b2c2fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143537f expref: 11 pid: 18934 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638799.825189:0:21053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21053:1875523183709824:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638799.825229:0:21053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.825238:0:21053:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.825244:0:21053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638799.825250:0:21053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c35d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638800.543949:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638800.608905:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638800.608928:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183710720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638800.608996:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638800.609181:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710720 00000100:00100000:0.0:1788638800.609191:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710720 00000100:00100000:0.0:1788638800.609254:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638800.609264:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183710720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638800.609296:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788638800.609360:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183710720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638800.609367:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638800.609417:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183710720:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638800.609486:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638801.282344:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.283708:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280192 00000100:00100000:1.0:1788638801.283732:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280192 00000100:00100000:1.0:1788638801.283842:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 105 00000100:00100000:1.0:1788638801.283854:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+11:16758:x1875523174280192:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638801.283871:0:18936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638801.283902:0:18936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308a00/0xa0b1f1e3b4b2c364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435412 expref: -99 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.283930:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308a00/0xa0b1f1e3b4b2c364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435412 expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.283941:0:18936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308a00/0xa0b1f1e3b4b2c364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435412 expref: 12 pid: 18936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.283950:0:18936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308a00, rc 0) 00000100:00100000:1.0:1788638801.284015:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280192:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638801.284023:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 105 00000100:00100000:1.0:1788638801.286803:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638801.286971:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280320 00000100:00100000:3.0:1788638801.286981:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280320 00000100:00100000:3.0:1788638801.287036:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00100000:3.0:1788638801.287046:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280320:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638801.287524:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280320:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 478us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638801.287534:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00100000:2.0:1788638801.290134:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.291951:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280448 00000100:00100000:1.0:1788638801.291965:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280448 00000100:00100000:1.0:1788638801.292032:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 107 00000100:00100000:1.0:1788638801.292043:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280448:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.293020:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280448:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 974us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638801.293032:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 107 00000100:00100000:1.0:1788638801.314466:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638801.314626:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280576 00000100:00100000:0.0:1788638801.314636:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280576 00000100:00100000:0.0:1788638801.314693:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 108 00000100:00100000:0.0:1788638801.314704:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+12:16758:x1875523174280576:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638801.314734:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638801.314754:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5466c00/0xa0b1f1e3b4b2c36b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435419 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.314820:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5466c00/0xa0b1f1e3b4b2c36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435419 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.314833:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5466c00/0xa0b1f1e3b4b2c36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435419 expref: 13 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.314861:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466c00, rc 0) 00000100:00100000:0.0:1788638801.314922:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16758:x1875523174280576:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 220us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.314929:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 108 00000100:00100000:2.0:1788638801.323257:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.323362:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280704 00000100:00100000:1.0:1788638801.323372:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280704 00000100:00100000:1.0:1788638801.323432:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 109 00000100:00100000:1.0:1788638801.323442:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16758:x1875523174280704:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.323754:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16758:x1875523174280704:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 312us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638801.323770:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 109 00000100:00100000:2.0:1788638801.338269:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638801.338342:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280832 00000100:00100000:3.0:1788638801.338351:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280832 00000100:00100000:3.0:1788638801.338400:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 110 00000100:00100000:3.0:1788638801.338408:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16758:x1875523174280832:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638801.338651:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:16758:x1875523174280832:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 242us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638801.338660:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 110 10000000:01000000:1.0:1788638801.375983:0:18939:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638801.375991:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bd185000 from 10 10000000:01000000:1.0:1788638801.375997:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638801.376048:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.376060:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.376071:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.376099:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183710848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.376174:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.376246:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638801.376325:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710848 00000100:00100000:0.0:1788638801.376332:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710848 00000100:00100000:0.0:1788638801.376384:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788638801.376392:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+16:18939:x1875523183710848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638801.376406:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638801.376418:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5467600/0xa0b1f1e3b4b2c379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c372 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.376440:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5467600/0xa0b1f1e3b4b2c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c372 expref: 17 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.376451:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5467600/0xa0b1f1e3b4b2c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c372 expref: 17 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.376459:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467600, rc 0) 00000100:00100000:0.0:1788638801.376506:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183710848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.376513:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788638801.376985:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183710848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638801.377002:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c379 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.377011:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c379 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.377068:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183710976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.377099:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.377130:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638801.379940:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183710976 00000100:00100000:0.0:1788638801.379956:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183710976 00000100:00100000:0.0:1788638801.380023:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788638801.380033:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183710976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638801.380337:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183710976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.380344:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788638801.385003:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183710976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.385090:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.385167:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.385218:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638801.385833:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711104 00000100:00100000:3.0:1788638801.385842:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711104 00000100:00100000:3.0:1788638801.385897:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788638801.385906:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183711104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638801.386110:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183711104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638801.386118:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788638801.386285:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788638801.395726:0:21066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788638801.395928:0:18939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788638801.395951:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638801.395963:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c379 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.395975:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385308e00/0xa0b1f1e3b4b2c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c379 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638801.395986:0:18939:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638801.395989:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387348000 from 10 10000000:01000000:1.0:1788638801.395992:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638801.396104:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.396113:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.396125:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.396149:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.396216:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.396263:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638801.398824:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711232 00000100:00100000:2.0:1788638801.398840:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711232 00000100:00100000:2.0:1788638801.398923:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788638801.398933:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+17:18939:x1875523183711232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638801.398949:0:18937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638801.398966:0:18937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6000/0xa0b1f1e3b4b2c387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c380 expref: -99 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638801.398993:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6000/0xa0b1f1e3b4b2c387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c380 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638801.399004:0:18937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6000/0xa0b1f1e3b4b2c387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c380 expref: 18 pid: 18937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638801.399012:0:18937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638801.399090:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638801.399097:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788638801.399125:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638801.399151:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c387 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.399161:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c387 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.399231:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.399266:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.399302:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638801.399346:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711360 00000100:00100000:0.0:1788638801.399350:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711360 00000100:00100000:0.0:1788638801.399381:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788638801.399388:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638801.399648:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.399656:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788638801.399777:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.399841:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.399880:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.399896:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638801.399956:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711488 00000100:00100000:2.0:1788638801.399961:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711488 00000100:00100000:2.0:1788638801.399981:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788638801.399987:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638801.400143:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638801.400150:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788638801.402291:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788638801.403702:0:21067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788638801.404015:0:18939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788638801.404054:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638801.404066:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c387 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.404077:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385309c00/0xa0b1f1e3b4b2c380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c387 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638801.404087:0:18939:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638801.404090:0:18939:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bc901800 from 10 10000000:01000000:1.0:1788638801.404092:0:18939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638801.404128:0:18939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.404137:0:18939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.404161:0:18939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.404187:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.404248:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.404290:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638801.404432:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711616 00000100:00100000:3.0:1788638801.404440:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711616 00000100:00100000:3.0:1788638801.404649:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788638801.404667:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+18:18939:x1875523183711616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638801.404680:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638801.404693:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2c38e expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.404716:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c38e expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.404727:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2c395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2c38e expref: 19 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.404735:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fce00, rc 0) 00000100:00100000:3.0:1788638801.404806:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183711616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638801.404813:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788638801.404892:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638801.404906:0:18939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c395 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.404916:0:18939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2c395 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.404974:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.405001:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.409266:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638801.411864:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711744 00000100:00100000:0.0:1788638801.411878:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711744 00000100:00100000:0.0:1788638801.411941:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788638801.411951:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183711744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638801.412445:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183711744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (7441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.412454:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788638801.412568:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.412628:0:18939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638801.412676:0:18939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638801.412716:0:18939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638801.412870:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183711872 00000100:00100000:0.0:1788638801.412876:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183711872 00000100:00100000:0.0:1788638801.412900:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788638801.412906:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183711872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638801.413300:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:18939:x1875523183711872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 392us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.413307:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788638801.413382:0:18939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83477f13-c5f9-4c4e-acd2-08466075bc00:18939:1875523183711872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788638801.414468:0:21068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638801.419753:0:18939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638801.419931:0:18939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638801.419944:0:18939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c395 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.419957:0:18939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385308600/0xa0b1f1e3b4b2c38e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2c395 expref: -99 pid: 18939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638801.571688:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638801.730527:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638801.730642:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174280960 00000100:00100000:3.0:1788638801.730653:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174280960 00000100:00100000:3.0:1788638801.730779:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638801.730826:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:17367:x1875523174280960:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638801.730847:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638801.730884:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2c39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435420 expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730946:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730960:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730972:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730986:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730992:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.730999:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731305:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2c3b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731314:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731320:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638801.731343:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638801.731347:0:18944:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638801.731380:0:18944:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731395:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731401:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731406:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731412:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638801.731415:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731422:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731434:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:3.0:1788638801.731437:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638801.731442:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731449:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2c3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731463:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731470:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731475:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731486:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638801.731490:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731496:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731505:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7393e81b00) 00010000:00010000:3.0:1788638801.731508:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638801.731511:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731517:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731556:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2c39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435420 expref: 8 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731571:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2c3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435420 expref: 7 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.731588:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:3.0:1788638801.731591:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638801.731594:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:3.0:1788638801.731666:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:17367:x1875523174280960:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 844us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638801.731674:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00080000:1.0:1788638801.733372:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638801.738298:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.738400:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281216 00000100:00100000:1.0:1788638801.738434:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281216 00000100:00100000:1.0:1788638801.738493:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638801.738503:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+7:17367:x1875523174281216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638801.738523:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638801.738701:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c3b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435427 expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738808:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738923:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738936:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738954:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738962:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.738969:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.740754:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308400/0xa0b1f1e3b4b2c3cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.740775:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308400/0xa0b1f1e3b4b2c3cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.740879:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308400/0xa0b1f1e3b4b2c3cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638801.740902:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788638801.741126:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741134:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741141:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741146:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638801.741298:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741308:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741322:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:1.0:1788638801.741325:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.741331:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741337:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741351:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741357:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741373:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741378:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638801.741381:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741386:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741394:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7398420a00) 00010000:00010000:1.0:1788638801.741396:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.741399:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.741404:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.745394:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c3b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435427 expref: 10 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.745435:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308400/0xa0b1f1e3b4b2c3cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435427 expref: 9 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.745446:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7398420d00) 00010000:00010000:1.0:1788638801.745450:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.745453:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308400, rc 0) 00000100:00100000:1.0:1788638801.745607:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17367:x1875523174281216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 7103us (7317us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788638801.745628:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:2.0:1788638801.763057:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638801.764779:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281344 00000100:00100000:0.0:1788638801.764934:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281344 00000100:00100000:0.0:1788638801.765004:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:0.0:1788638801.765014:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17367:x1875523174281344:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788638801.765120:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17367:x1875523174281344:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 Request processed in 107us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.765127:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:2.0:1788638801.852344:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.852462:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281472 00000100:00100000:1.0:1788638801.852472:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281472 00000100:00100000:1.0:1788638801.852545:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:1.0:1788638801.852556:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17373:x1875523174281472:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638801.852587:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638801.852610:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c3db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143542e expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852677:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852693:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852706:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852719:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852725:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852731:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852962:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852978:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852985:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.852991:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638801.852996:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853003:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853015:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:1.0:1788638801.853019:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.853024:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853031:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853044:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853050:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853056:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853061:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638801.853069:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853075:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853083:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7398420a00) 00010000:00010000:1.0:1788638801.853086:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.853089:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853095:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c3e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853126:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c3db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143542e expref: 10 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853137:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:1.0:1788638801.853139:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638801.853142:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c3db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143542e expref: 10 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.853152:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309a00, rc 0) 00000100:00100000:1.0:1788638801.853220:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17373:x1875523174281472:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 664us (886us total) trans 0 rc 301/301 00000100:00100000:1.0:1788638801.853227:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:2.0:1788638801.861275:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638801.862863:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281600 00000100:00100000:0.0:1788638801.862879:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281600 00000100:00100000:0.0:1788638801.862944:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638801.862956:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17373:x1875523174281600:12345-192.168.203.34@tcp:700:lfs.0 00000100:00100000:0.0:1788638801.863053:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17373:x1875523174281600:12345-192.168.203.34@tcp:700:lfs.0 Request processed in 99us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638801.863060:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638801.865065:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638801.865142:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281856 00000100:00100000:3.0:1788638801.865171:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281856 00000100:00100000:3.0:1788638801.865222:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:3.0:1788638801.865232:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17373:x1875523174281856:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:3.0:1788638801.865283:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638801.865305:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2c31e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14353a9 expref: 9 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.865325:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:3.0:1788638801.865330:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638801.865523:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.865750:0:18944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 5 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.865763:0:18944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.865848:0:18944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 5 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.865862:0:18944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 5 pid: 18943 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638801.865876:0:18944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18944:1875523183712000:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638801.865972:0:18944:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398edd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788638801.872251:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638801.872438:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174281984 00000100:00100000:1.0:1788638801.872448:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174281984 00010000:00010000:1.0:1788638801.872510:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 6 pid: 18943 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638801.872524:0:18944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18944:1875523183712000:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638801.872560:0:18944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638801.872567:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638801.872583:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:2364:x1875523174281984:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638801.872598:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638801.872606:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 6 pid: 18943 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872618:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 6 pid: 18943 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872640:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2c356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143540b expref: 6 pid: 18943 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872656:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:1.0:1788638801.872660:0:18929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872669:0:18929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872677:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638801.872709:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638801.872760:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2364:x1875523174281984:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 185us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638801.872767:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00080000:2.0:1788638801.873110:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788638801.873206:0:18944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.873214:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.873238:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.873247:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.873255:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638801.874980:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638801.874997:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875006:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875014:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875020:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638801.875024:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875032:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875062:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9800) 00010000:00010000:0.0:1788638801.875066:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638801.875072:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638801.875079:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2c3f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638801.875103:0:18944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040b12f77 reply state 00000000d308ee98 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638801.875112:0:18944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638801.875208:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+10:17373:x1875523174281856:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 9973us (10147us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788638801.875218:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00010000:00010000:3.0:1788638801.882761:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882829:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882840:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882846:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638801.882852:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882861:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882899:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7393e81b00) 00010000:00010000:3.0:1788638801.882902:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638801.882907:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638801.882914:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c3f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788638801.952457:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788638802.066344:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.066516:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174282112 00000100:00100000:0.0:1788638802.066527:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174282112 00000100:00100000:0.0:1788638802.066615:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638802.066625:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+9:17381:x1875523174282112:12345-192.168.203.34@tcp:101:lctl.0 00010000:00010000:0.0:1788638802.066647:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.066669:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435435 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066732:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466200/0xa0b1f1e3b4b2c405 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066747:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466200/0xa0b1f1e3b4b2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066777:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466200/0xa0b1f1e3b4b2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.066844:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638802.066848:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638802.066886:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466200/0xa0b1f1e3b4b2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066913:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435435 expref: 11 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066933:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466200/0xa0b1f1e3b4b2c405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435435 expref: 10 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.066942:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.066945:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638802.066949:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466200, rc 0) 00000100:00100000:0.0:1788638802.067017:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+10:17381:x1875523174282112:12345-192.168.203.34@tcp:101:lctl.0 Request processed in 393us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.067025:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638802.095407:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.095667:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174282240 00000100:00100000:0.0:1788638802.095678:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174282240 00000100:00100000:0.0:1788638802.095816:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:0.0:1788638802.095827:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:17382:x1875523174282240:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638802.095848:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.095866:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c40c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143543c expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.095945:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2c413 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.095959:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2c413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.095970:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2c413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.096002:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638802.096006:0:18944:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638802.096024:0:18944:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2c413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.096047:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c40c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143543c expref: 7 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.096067:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2c413 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143543c expref: 6 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.096076:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.096079:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638802.096082:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466800, rc 0) 00000100:00100000:0.0:1788638802.096148:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:17382:x1875523174282240:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 322us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.096155:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:3.0:1788638802.099156:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.099237:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174282368 00000100:00100000:0.0:1788638802.099245:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174282368 00000100:00100000:0.0:1788638802.099327:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:0.0:1788638802.099338:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+6:17382:x1875523174282368:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638802.099358:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.099378:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c41a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435443 expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099445:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099459:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099469:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099483:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099488:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099494:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099924:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099933:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.099940:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.099986:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638802.099989:0:18942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638802.100006:0:18942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100019:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100026:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100032:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100038:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638802.100043:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100049:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100061:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.100063:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638802.100067:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100073:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100087:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100104:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100109:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100114:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638802.100117:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100122:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100130:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c73862a3d00) 00010000:00010000:0.0:1788638802.100132:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638802.100135:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100140:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c428 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100177:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c41a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435443 expref: 8 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100191:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435443 expref: 7 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.100197:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c73862a3200) 00010000:00010000:0.0:1788638802.100199:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638802.100207:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467800, rc 0) 00000100:00100000:0.0:1788638802.100386:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+7:17382:x1875523174282368:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1047us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.100394:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:1.0:1788638802.108473:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.108657:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174282624 00000100:00100000:0.0:1788638802.108667:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174282624 00000100:00100000:0.0:1788638802.108828:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638802.108838:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+7:17382:x1875523174282624:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638802.108859:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.108878:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143544a expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.108967:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638802.109084:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c436 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143544a expref: 9 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.109099:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.109102:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638802.109108:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467e00/0xa0b1f1e3b4b2c436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143544a expref: 9 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.109122:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467e00, rc 0) 00000100:00100000:0.0:1788638802.109313:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+8:17382:x1875523174282624:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 475us (849us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788638802.109320:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:2.0:1788638802.112844:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.112985:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174282880 00000100:00100000:0.0:1788638802.112996:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174282880 00000100:00100000:0.0:1788638802.113053:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:0.0:1788638802.113071:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+8:17382:x1875523174282880:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:0.0:1788638802.113124:0:18942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638802.113147:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c42f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435443 expref: 8 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.113179:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c73862a3200) 00010000:00010000:0.0:1788638802.113189:0:18942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638802.113210:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.113221:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.113230:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638802.113441:0:18942:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013c5cd7 reply state 00000000836773f1 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638802.113451:0:18942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788638802.113459:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788638802.113670:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+9:17382:x1875523174282880:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 600us (835us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788638802.113678:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:2.0:1788638802.115835:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.116007:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174283136 00000100:00100000:3.0:1788638802.116018:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174283136 00000100:00100000:3.0:1788638802.116079:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:3.0:1788638802.116090:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+9:17382:x1875523174283136:12345-192.168.203.34@tcp:35:lfs.0 00010000:00010000:1.0:1788638802.116199:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.116209:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.116216:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.116222:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638802.116226:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.116233:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.116247:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c73862a3d00) 00010000:00010000:1.0:1788638802.116250:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788638802.116255:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638802.117084:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+10:17382:x1875523174283136:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 992us (1254us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788638802.117094:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00010000:00010000:1.0:1788638802.118840:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466400/0xa0b1f1e3b4b2c444 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638802.120487:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.120599:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174283392 00000100:00100000:0.0:1788638802.120610:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174283392 00000100:00100000:0.0:1788638802.120675:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638802.120685:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+9:17382:x1875523174283392:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638802.120711:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.120745:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435451 expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120846:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120860:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120872:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120885:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120891:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.120897:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.121002:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638802.121101:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121109:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121115:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121121:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638802.121125:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121156:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121172:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.121175:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638802.121180:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121187:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2c452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121201:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121208:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121213:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121217:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638802.121220:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121226:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121232:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638802.121235:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638802.121238:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121253:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121299:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c44b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435451 expref: 11 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121309:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:0.0:1788638802.121311:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638802.121314:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435451 expref: 11 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.121324:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467000, rc 0) 00000100:00100000:0.0:1788638802.121383:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+10:17382:x1875523174283392:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 699us (905us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788638802.121391:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638802.124723:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.124828:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174283520 00000100:00100000:3.0:1788638802.124838:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174283520 00000100:00100000:3.0:1788638802.124898:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:3.0:1788638802.124908:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+10:17382:x1875523174283520:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638802.124934:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638802.124956:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c467 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435458 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125034:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125060:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125069:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638802.125089:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638802.125091:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638802.125104:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125122:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c467 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 12 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125135:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 11 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.125141:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:3.0:1788638802.125143:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638802.125146:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031600, rc 0) 00000100:00100000:3.0:1788638802.125212:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:17382:x1875523174283520:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 305us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638802.125220:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:2.0:1788638802.129528:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.129604:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174283648 00000100:00100000:0.0:1788638802.129614:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174283648 00000100:00100000:0.0:1788638802.129673:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638802.129683:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:17382:x1875523174283648:12345-192.168.203.34@tcp:37:lfs.0 00000100:00100000:0.0:1788638802.135265:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:17382:x1875523174283648:12345-192.168.203.34@tcp:37:lfs.0 Request processed in 5573us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.135278:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:2.0:1788638802.139164:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.139260:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174283904 00000100:00100000:3.0:1788638802.139270:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174283904 00000100:00100000:3.0:1788638802.139370:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638802.139381:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738528ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:17382:x1875523174283904:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638802.139679:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738528ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+12:17382:x1875523174283904:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 298us (524us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788638802.139701:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:2.0:1788638802.144053:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638802.145193:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638802.145264:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638802.145519:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712128 00000100:00100000:0.0:1788638802.145527:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712128 00000100:00100000:0.0:1788638802.145641:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638802.145663:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183712128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638802.145700:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638802.145747:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183712128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.145754:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638802.145779:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183712384:0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.145822:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638802.145854:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638802.145860:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183712512:0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.145885:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638802.145958:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183712640:0@lo:400:kworker.0 00000100:00100000:1.0:1788638802.145988:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638802.146016:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788638802.146021:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183712256:0@lo:400:kworker.0 00000100:00100000:1.0:1788638802.146061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638802.146084:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183712768:0@lo:400:kworker.0 00000100:00100000:1.0:1788638802.146103:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638802.146130:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712512 00000100:00100000:1.0:1788638802.146134:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712512 00000100:00100000:1.0:1788638802.146154:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712640 00000100:00100000:1.0:1788638802.146157:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712640 00000100:00100000:3.0:1788638802.146208:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712384 00000100:00100000:3.0:1788638802.146212:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712384 00000100:00100000:0.0:1788638802.146255:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712768 00000100:00100000:0.0:1788638802.146258:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712768 00000100:00080000:2.0:1788638802.146349:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638802.146354:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638802.146356:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638802.146396:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638802.146664:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638802.146670:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183712512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638802.146719:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183712512:12345-0@lo:400:kworker.0 Request processed in 48us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638802.146725:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638802.146739:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788638802.146744:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183712640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638802.146776:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183712640:12345-0@lo:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638802.146800:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788638802.146827:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183712640:0@lo:400:kworker.0 00000100:00100000:3.0:1788638802.146923:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638802.146932:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183712384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638802.146968:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183712384:12345-0@lo:400:kworker.0 Request processed in 39us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638802.146974:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638802.146995:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183712256 00000100:00100000:3.0:1788638802.146999:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183712256 00000100:00100000:3.0:1788638802.147023:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788638802.147029:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3293:x1875523183712256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638802.147061:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3293:x1875523183712256:12345-0@lo:400:kworker.0 Request processed in 32us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638802.147067:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788638802.147152:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83477f13-c5f9-4c4e-acd2-08466075bc00:3293:1875523183712256:0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.147226:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183712512:0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.147236:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183712384:0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.147281:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638802.147288:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638802.147335:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183712768:12345-0@lo:400:kworker.0 Request processed in 48us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.147342:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788638802.147458:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183712768:0@lo:400:kworker.0 00000100:00100000:2.0:1788638802.215011:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638802.215103:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174284032 00000100:00100000:1.0:1788638802.215113:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174284032 00000100:00100000:1.0:1788638802.215182:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:1.0:1788638802.215192:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+10:17388:x1875523174284032:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:1.0:1788638802.215211:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638802.215231:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143545f expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215311:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215323:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215332:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215342:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215347:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215351:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215433:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2c48a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215441:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2c48a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215447:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2c48a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638802.215472:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788638802.215476:0:18942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638802.215511:0:18942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2c48a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215535:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215541:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215548:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215554:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638802.215558:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215566:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215588:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:1.0:1788638802.215591:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638802.215595:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215602:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c47c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215615:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215620:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215625:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215637:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638802.215640:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215646:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215654:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7398420a00) 00010000:00010000:1.0:1788638802.215656:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638802.215658:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215664:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215693:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143545f expref: 12 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215708:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2c48a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143545f expref: 11 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.215715:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:1.0:1788638802.215717:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788638802.215720:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308c00, rc 0) 00000100:00100000:1.0:1788638802.215860:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+11:17388:x1875523174284032:12345-192.168.203.34@tcp:101:bash.0 Request processed in 669us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638802.215868:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:1.0:1788638802.222197:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.222362:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174284288 00000100:00100000:3.0:1788638802.222373:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174284288 00000100:00100000:3.0:1788638802.222430:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:3.0:1788638802.222441:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+11:17388:x1875523174284288:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638802.222462:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638802.222481:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c491 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435466 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.222616:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.222636:0:18943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 11 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.222645:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.222679:0:18943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 11 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.222693:0:18943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 11 pid: 18943 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638802.222707:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738672c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183712896:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638802.222846:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638802.225905:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.226102:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174284416 00000100:00100000:0.0:1788638802.226112:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174284416 00010000:00010000:0.0:1788638802.226151:0:18928:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 12 pid: 18943 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638802.226193:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638802.226203:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+12:2364:x1875523174284416:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638802.226237:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638802.226245:0:18928:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 12 pid: 18943 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.226274:0:18928:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 12 pid: 18943 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.226296:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:0.0:1788638802.226301:0:18928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.226310:0:18928:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.226318:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.226335:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638802.226383:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+12:2364:x1875523174284416:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 182us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.226391:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00010000:00010000:3.0:1788638802.227035:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c46e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435458 expref: 11 pid: 18943 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638802.227054:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738672c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183712896:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638802.227077:0:18943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.227087:0:18943:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.227093:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.227115:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.227135:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.227144:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229264:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229284:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229296:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638802.229309:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788638802.229339:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229361:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229368:0:18943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229374:0:18943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638802.229377:0:18943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229384:0:18943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229398:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:2.0:1788638802.229401:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638802.229406:0:18943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229413:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2c498 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638802.229441:0:18943:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cd4d9be reply state 00000000190746a8 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638802.229451:0:18943:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788638802.229488:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2c491 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 14 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229504:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 13 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.229522:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638802.229524:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788638802.229526:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7600, rc 0) 00000100:00100000:2.0:1788638802.229725:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+14:17388:x1875523174284288:12345-192.168.203.34@tcp:101:bash.0 Request processed in 7285us (7546us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788638802.229733:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 28 00010000:00010000:3.0:1788638802.234999:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235020:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235028:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235033:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638802.235039:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235046:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235063:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c7393e81b00) 00010000:00010000:3.0:1788638802.235066:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638802.235071:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.235076:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c49f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638802.272642:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.272735:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174284544 00000100:00100000:0.0:1788638802.272745:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174284544 00000100:00100000:0.0:1788638802.272829:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:0.0:1788638802.272840:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+13:17388:x1875523174284544:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638802.272862:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638802.272883:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c4b4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143546d expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.272970:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.272985:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.272996:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638802.273033:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788638802.273037:0:18944:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638802.273059:0:18944:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.273070:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.273096:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2c4b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143546d expref: 15 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.273117:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143546d expref: 14 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638802.273125:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:0.0:1788638802.273128:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638802.273132:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466000, rc 0) 00000100:00100000:0.0:1788638802.273198:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+14:17388:x1875523174284544:12345-192.168.203.34@tcp:101:bash.0 Request processed in 361us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638802.273204:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:2.0:1788638802.277214:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.277366:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174284800 00000100:00100000:0.0:1788638802.277506:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174284800 00000100:00100000:0.0:1788638802.277585:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638802.277596:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+14:17388:x1875523174284800:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:0.0:1788638802.278832:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+15:17388:x1875523174284800:12345-192.168.203.34@tcp:35:bash.0 Request processed in 1229us (1621us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788638802.278843:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:3.0:1788638802.415904:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638802.416029:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174285056 00000100:00100000:2.0:1788638802.416041:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174285056 00000100:00100000:2.0:1788638802.416102:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:2.0:1788638802.416113:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+15:17398:x1875523174285056:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638802.416137:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638802.416160:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435474 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638802.416253:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788638802.416380:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435474 expref: 17 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.416396:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:2.0:1788638802.416399:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638802.416405:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435474 expref: 17 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.416418:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6800, rc 0) 00000100:00100000:2.0:1788638802.416505:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+16:17398:x1875523174285056:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 393us (611us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788638802.416512:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:2.0:1788638802.422130:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.422270:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174285312 00000100:00100000:3.0:1788638802.422279:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174285312 00000100:00100000:3.0:1788638802.422378:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638802.422390:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+16:17398:x1875523174285312:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638802.423006:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17398:x1875523174285312:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 615us (882us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788638802.423017:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638802.465220:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638802.465363:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174285568 00000100:00100000:1.0:1788638802.465373:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174285568 00000100:00100000:1.0:1788638802.465595:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:1.0:1788638802.465608:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17401:x1875523174285568:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638802.465632:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638802.465653:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c4d0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143547b expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.465750:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c4d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.465765:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c4d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.465777:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c4d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638802.465820:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788638802.465959:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c4d0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143547b expref: 20 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.465980:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c4d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143547b expref: 19 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.465990:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638802.465994:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638802.465997:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309e00, rc 0) 00000100:00100000:1.0:1788638802.466068:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+19:17401:x1875523174285568:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 463us (858us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788638802.466091:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:3.0:1788638802.469301:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.471137:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.471210:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174285824 00000100:00100000:3.0:1788638802.471219:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174285824 00000100:00100000:3.0:1788638802.471276:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638802.471285:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+19:2367:x1875523174285824:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638802.471300:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638802.471323:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2c4d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143547b expref: 19 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638802.471339:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:3.0:1788638802.471344:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638802.471388:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+18:2367:x1875523174285824:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638802.471395:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638802.472667:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174285696 00000100:00100000:2.0:1788638802.472677:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174285696 00000100:00100000:2.0:1788638802.472722:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:2.0:1788638802.472730:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+18:17401:x1875523174285696:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638802.472819:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472836:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472847:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472871:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472877:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472884:0:18943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472890:0:18943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638802.472894:0:18943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472901:0:18943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472923:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638802.472926:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638802.472930:0:18943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.472937:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4e5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638802.472991:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+18:17401:x1875523174285696:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 262us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638802.472998:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:2.0:1788638802.479104:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638802.479236:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174286080 00000100:00100000:3.0:1788638802.479245:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174286080 00000100:00100000:3.0:1788638802.479303:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638802.479312:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+18:17401:x1875523174286080:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638802.479567:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+19:17401:x1875523174286080:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 255us (473us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788638802.479585:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00010000:00010000:1.0:1788638802.591944:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638802.921549:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638802.921698:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174286336 00000100:00100000:2.0:1788638802.921708:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174286336 00000100:00100000:2.0:1788638802.921772:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:2.0:1788638802.921824:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+19:17433:x1875523174286336:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:2.0:1788638802.921848:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638802.921868:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4ec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435482 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.921964:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c4f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.921980:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c4f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.921993:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c4f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638802.922022:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788638802.922185:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c4ec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435482 expref: 22 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.922205:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c4f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435482 expref: 21 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638802.922214:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638802.922217:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638802.922221:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7000, rc 0) 00000100:00100000:2.0:1788638802.922273:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+21:17433:x1875523174286336:12345-192.168.203.34@tcp:101:cat.0 Request processed in 493us (743us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788638802.922281:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:3.0:1788638802.925486:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638802.925594:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174286464 00000100:00100000:1.0:1788638802.925605:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174286464 00000100:00100000:1.0:1788638802.925667:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638802.925677:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+21:2364:x1875523174286464:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638802.925693:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638802.925716:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c4f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435482 expref: 21 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638802.925735:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638802.925756:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638802.925851:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+20:2364:x1875523174286464:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638802.925858:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:3.0:1788638802.933335:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638802.933624:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174286720 00000100:00100000:0.0:1788638802.933634:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174286720 00000100:00100000:0.0:1788638802.933703:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638802.933714:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+20:17433:x1875523174286720:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:0.0:1788638802.934079:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+21:17433:x1875523174286720:12345-192.168.203.34@tcp:35:cat.0 Request processed in 366us (752us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788638802.934086:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638803.064131:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638803.064235:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174286976 00000100:00100000:1.0:1788638803.064246:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174286976 00000100:00100000:1.0:1788638803.064322:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:1.0:1788638803.064333:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+21:17439:x1875523174286976:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:1.0:1788638803.064355:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638803.064376:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c501 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435489 expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.064484:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.064498:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.064524:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638803.064537:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788638803.064705:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c501 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 24 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.064724:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.064732:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638803.064734:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638803.064751:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309400, rc 0) 00000100:00100000:1.0:1788638803.064850:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+23:17439:x1875523174286976:12345-192.168.203.34@tcp:101:dd.0 Request processed in 520us (729us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788638803.064857:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00080000:2.0:1788638803.065184:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638803.075563:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.075668:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638803.076957:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174287360 00000100:00100000:1.0:1788638803.076970:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174287360 00000100:00100000:1.0:1788638803.077039:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:1.0:1788638803.077050:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+23:17439:x1875523174287360:12345-192.168.203.34@tcp:36:dd.0 00010000:00010000:1.0:1788638803.077108:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638803.077134:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2c4bb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143546d expref: 23 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.077158:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638803.077163:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638803.077382:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.077397:0:18944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.077406:0:18944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.077440:0:18944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.077453:0:18944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638803.077466:0:18944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18944:1875523183713024:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638803.077577:0:18944:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788638803.082855:0:18944:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.34@tcp) returned -22 from blocking AST (req@000000001ab8ae23 x1875523183713024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.082880:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.082903:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c508 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435489 expref: 23 pid: 18942 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638803.082919:0:18944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18944:1875523183713024:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638803.082940:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638803.082959:0:18944:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.082970:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.082977:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.082997:0:18944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.083007:0:18944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.083013:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638803.083137:0:18944:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788638803.083198:0:18944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e34b0a9 reply state 00000000b814c2d6 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638803.083207:0:18944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788638803.083312:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+24:17439:x1875523174287360:12345-192.168.203.34@tcp:36:dd.0 Request processed in 6262us (7642us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788638803.083321:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00000020:00080000:1.0:1788638803.083326:0:18944:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788638803.083999:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174287104 00000100:00100000:0.0:1788638803.084008:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174287104 00000100:00100000:0.0:1788638803.084064:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638803.084073:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385331050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+24:2367:x1875523174287104:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638803.084087:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638803.084090:0:18928:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a0b1f1e3b4b2c508) 00010000:00010000:0.0:1788638803.084091:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638803.084129:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385331050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+24:2367:x1875523174287104:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 57us (8576us total) trans 0 rc 116/116 00000100:00100000:0.0:1788638803.084135:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00010000:00010000:1.0:1788638803.086888:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086903:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086929:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086935:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638803.086940:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086948:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086965:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638803.086968:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638803.086973:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.086980:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c516 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638803.182930:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638803.183027:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174287616 00000100:00100000:0.0:1788638803.183051:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174287616 00000100:00100000:0.0:1788638803.183113:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638803.183125:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+23:17439:x1875523174287616:12345-192.168.203.34@tcp:35:dd.0 00000100:00100000:0.0:1788638803.183387:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+24:17439:x1875523174287616:12345-192.168.203.34@tcp:35:dd.0 Request processed in 264us (466us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788638803.183395:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638803.206533:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.206586:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638803.206704:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288000 00000100:00100000:0.0:1788638803.206714:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288000 00000100:00100000:0.0:1788638803.206809:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638803.206819:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2365:x1875523174288000:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638803.206886:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2365:x1875523174288000:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638803.206893:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:2.0:1788638803.207827:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174287744 00000100:00100000:2.0:1788638803.207836:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174287744 00000100:00100000:2.0:1788638803.207898:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:2.0:1788638803.207908:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2365:x1875523174287744:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638803.207968:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1c47af9-dda1-43c0-a01f-d15aafaa43be+13:2365:x1875523174287744:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 61us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.207977:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00080000:1.0:1788638803.208342:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638803.212485:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.212540:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.212577:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.212611:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.212643:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288256 00000100:00100000:3.0:1788638803.212653:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288256 00000100:00100000:3.0:1788638803.212702:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174287872 00000100:00100000:3.0:1788638803.212705:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174287872 00000100:00100000:3.0:1788638803.212720:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288384 00000100:00100000:3.0:1788638803.212722:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288384 00000100:00100000:3.0:1788638803.212750:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638803.212760:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2365:x1875523174288256:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638803.212853:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2365:x1875523174288256:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638803.212860:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638803.212877:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:2.0:1788638803.213089:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288128 00000100:00100000:2.0:1788638803.213094:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288128 00000100:00100000:2.0:1788638803.213128:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:2.0:1788638803.213135:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:2365:x1875523174288128:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638803.213191:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+11:2365:x1875523174288128:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 56us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.213198:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:3.0:1788638803.215898:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2365:x1875523174287872:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638803.215966:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2365:x1875523174287872:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 84us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638803.217012:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:0.0:1788638803.217030:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2365:x1875523174288384:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638803.217076:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:582b3c6d-c6fc-4265-b417-9d8f18b5c8ef+5:2365:x1875523174288384:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 55us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638803.217084:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00080000:0.0:1788638803.217295:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638803.217301:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638803.217304:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638803.219022:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:0.0:1788638803.442638:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638803.443089:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288512 00000100:00100000:1.0:1788638803.443101:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288512 00000100:00100000:1.0:1788638803.443168:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:1.0:1788638803.443178:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+24:17453:x1875523174288512:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:1.0:1788638803.443202:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638803.443223:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c51d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435490 expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444701:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444743:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444755:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444776:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444809:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444816:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444909:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444917:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.444924:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638803.444962:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788638803.444966:0:18944:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638803.445009:0:18944:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445022:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445039:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445045:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445051:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445057:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638803.445060:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445067:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445078:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:1.0:1788638803.445081:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638803.445086:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445092:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2c524 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445107:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445114:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445120:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445132:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638803.445135:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445141:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445148:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c7398420a00) 00010000:00010000:1.0:1788638803.445150:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638803.445152:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445157:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2c52b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445195:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2c51d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435490 expref: 26 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445209:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435490 expref: 25 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638803.445217:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:1.0:1788638803.445219:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638803.445222:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309000, rc 0) 00000100:00100000:1.0:1788638803.446586:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+25:17453:x1875523174288512:12345-192.168.203.34@tcp:101:stat.0 Request processed in 3400us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638803.446598:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:0.0:1788638803.534554:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.534683:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288768 00000100:00100000:2.0:1788638803.534693:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288768 00000100:00100000:2.0:1788638803.534763:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:2.0:1788638803.534775:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+25:17459:x1875523174288768:12345-192.168.203.34@tcp:36:truncate.0 00010000:00010000:2.0:1788638803.534875:0:18942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638803.534901:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2c532 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435490 expref: 25 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.534921:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.534926:0:18942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638803.535327:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.535341:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.535351:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638803.535424:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1788638803.535452:0:18942:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054518ae6 reply state 000000006d4bcbe9 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.535462:0:18942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638803.537765:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+27:17459:x1875523174288768:12345-192.168.203.34@tcp:36:truncate.0 Request processed in 2983us (3211us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788638803.537810:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00000020:00080000:2.0:1788638803.537818:0:18942:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788638803.542051:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542078:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542087:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542093:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638803.542098:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542105:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542123:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.542126:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638803.542132:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.542139:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c539 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.616087:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638803.757461:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.757618:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174288896 00000100:00100000:2.0:1788638803.757628:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174288896 00000100:00100000:2.0:1788638803.757731:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:2.0:1788638803.757742:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+26:17473:x1875523174288896:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:2.0:1788638803.758312:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.758336:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c540 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435497 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758401:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758416:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758427:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758441:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758448:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758454:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758549:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758558:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758575:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638803.758695:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788638803.758707:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638803.758731:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758743:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758751:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758758:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758764:0:18943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758771:0:18943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638803.758775:0:18943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758872:0:18943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758887:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:2.0:1788638803.758890:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638803.758895:0:18943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758902:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c547 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758915:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758931:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.758937:0:18943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759310:0:18943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638803.759314:0:18943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759320:0:18943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759330:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c738a6e9c00) 00010000:00010000:2.0:1788638803.759332:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638803.759335:0:18943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759342:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c54e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759378:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c540 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 28 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759392:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 27 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.759400:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.759403:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638803.759412:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7000, rc 0) 00000100:00100000:2.0:1788638803.759487:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+27:17473:x1875523174288896:12345-192.168.203.34@tcp:101:stat.0 Request processed in 1746us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.759495:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:3.0:1788638803.858883:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.859313:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174289152 00000100:00100000:2.0:1788638803.859325:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174289152 00000100:00100000:2.0:1788638803.859388:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:2.0:1788638803.859398:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+27:17483:x1875523174289152:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638803.859419:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.859438:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143549e expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638803.859538:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788638803.859669:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c55c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143549e expref: 29 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.859683:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:2.0:1788638803.859687:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638803.859692:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143549e expref: 29 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.859705:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6800, rc 0) 00000100:00100000:2.0:1788638803.860066:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+28:17483:x1875523174289152:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 667us (1190us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788638803.860074:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:3.0:1788638803.865384:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638803.865480:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174289408 00000100:00100000:0.0:1788638803.865490:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174289408 00000100:00100000:0.0:1788638803.865573:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638803.865583:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738528e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+28:17483:x1875523174289408:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638803.866043:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738528e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+29:17483:x1875523174289408:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 460us (667us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788638803.866052:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638803.934249:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.934397:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174289664 00000100:00100000:2.0:1788638803.934407:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174289664 00000100:00100000:2.0:1788638803.934464:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:2.0:1788638803.934487:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+29:17489:x1875523174289664:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638803.934512:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.934542:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c56a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354a5 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.934922:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935052:0:18943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935065:0:18943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 30 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935074:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935113:0:18943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 30 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935128:0:18943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 30 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.935141:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183713152:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638803.935250:0:18943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.935259:0:18943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.935278:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183713280:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638803.935303:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638803.943248:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.943352:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.943460:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183713152:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638803.943472:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18943:1875523183713280:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638803.943500:0:18943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638803.943854:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174289792 00000100:00100000:0.0:1788638803.943862:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174289792 00010000:00010000:0.0:1788638803.943905:0:18927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 31 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638803.943935:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174289920 00000100:00100000:0.0:1788638803.943940:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174289920 00010000:00010000:0.0:1788638803.943956:0:18927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 32 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638803.943988:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:0.0:1788638803.943999:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+32:2365:x1875523174289792:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638803.944018:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638803.944026:0:18927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 32 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944051:0:18927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 32 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944088:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2c555 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435497 expref: 32 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638803.944275:0:18929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788638803.944294:0:18929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788638803.944379:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:0.0:1788638803.944386:0:18927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944395:0:18927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944403:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638803.944849:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:2365:x1875523174289792:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 851us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638803.944859:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:0.0:1788638803.944883:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638803.944891:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+30:2365:x1875523174289920:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638803.944902:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638803.944908:0:18927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944920:0:18927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944936:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2c4a6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435466 expref: 30 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944946:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:0.0:1788638803.944950:0:18927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944969:0:18927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.944976:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.945001:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638803.945042:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+29:2365:x1875523174289920:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 152us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638803.945048:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00010000:00010000:0.0:1788638803.945079:0:18943:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.945087:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638803.945103:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788638803.945767:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2c56a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 30 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.945806:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 29 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638803.945814:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:0.0:1788638803.945817:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638803.945820:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7c00, rc 0) 00000100:00100000:0.0:1788638803.945849:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+29:17489:x1875523174289664:12345-192.168.203.34@tcp:101:bash.0 Request processed in 11364us (11611us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788638803.945866:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:3.0:1788638803.956170:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.956271:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290176 00000100:00100000:2.0:1788638803.956282:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290176 00000100:00100000:2.0:1788638803.956349:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:2.0:1788638803.956359:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+29:17489:x1875523174290176:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:2.0:1788638803.956641:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.956657:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.956669:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638803.956722:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1788638803.956746:0:18942:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006709c860 reply state 000000002d47fa50 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.956755:0:18942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638803.956871:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17489:x1875523174290176:12345-192.168.203.34@tcp:36:bash.0 Request processed in 512us (708us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788638803.956894:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00000020:00080000:2.0:1788638803.956899:0:18942:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788638803.960144:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960160:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960168:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960174:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638803.960179:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960187:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960203:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:3.0:1788638803.960207:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638803.960212:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.960232:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2c57f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638803.962099:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.962979:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290304 00000100:00100000:2.0:1788638803.962990:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290304 00000100:00100000:2.0:1788638803.963055:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:2.0:1788638803.963065:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17489:x1875523174290304:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638803.963086:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.963106:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2c586 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354ac expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.963169:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2c586 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ac expref: 32 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.963183:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2c586 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ac expref: 32 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.963200:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.963203:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638803.963207:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7a00, rc 0) 00000100:00100000:2.0:1788638803.963420:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17489:x1875523174290304:12345-192.168.203.34@tcp:101:bash.0 Request processed in 355us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.963428:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:1.0:1788638803.970279:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.970450:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290432 00000100:00100000:2.0:1788638803.970460:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290432 00000100:00100000:2.0:1788638803.970515:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:2.0:1788638803.970533:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17489:x1875523174290432:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638803.970573:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.970593:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c58d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354b3 expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.970672:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.970687:0:18942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 33 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.970696:0:18942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.970726:0:18942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 33 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.970738:0:18942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 33 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.970752:0:18942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183713408:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638803.970865:0:18942:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638803.974346:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638803.974530:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290560 00000100:00100000:3.0:1788638803.974540:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290560 00010000:00010000:3.0:1788638803.974587:0:18927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 34 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638803.974628:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638803.974636:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+34:2365:x1875523174290560:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638803.974650:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638803.974656:0:18927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 34 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.974670:0:18927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 34 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.974689:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:3.0:1788638803.974694:0:18927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.974704:0:18927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.974711:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638803.974728:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638803.974815:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+34:2365:x1875523174290560:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 178us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638803.974822:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00010000:00010000:2.0:1788638803.975470:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c571 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354a5 expref: 33 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638803.975489:0:18942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183713408:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638803.975523:0:18942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.975545:0:18942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.975551:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638803.975600:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788638803.975604:0:18942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638803.975621:0:18942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.975648:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c58d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354b3 expref: 33 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.975662:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354b3 expref: 32 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.975671:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.975673:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638803.975676:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638803.975719:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17489:x1875523174290432:12345-192.168.203.34@tcp:101:bash.0 Request processed in 5189us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.975726:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:0.0:1788638803.979842:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.979941:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290816 00000100:00100000:2.0:1788638803.979951:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290816 00000100:00100000:2.0:1788638803.980016:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:2.0:1788638803.980026:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17489:x1875523174290816:12345-192.168.203.34@tcp:103:bash.0 00010000:00010000:2.0:1788638803.980041:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788638803.980079:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c594 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354b3 expref: 32 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.980101:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2c586 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ac expref: 31 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.980112:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9200) 00010000:00010000:2.0:1788638803.980121:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638803.980170:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+30:17489:x1875523174290816:12345-192.168.203.34@tcp:103:bash.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.980176:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638803.982724:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.982820:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174290944 00000100:00100000:2.0:1788638803.982830:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174290944 00000100:00100000:2.0:1788638803.982881:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:2.0:1788638803.982891:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+30:17489:x1875523174290944:12345-192.168.203.34@tcp:58:bash.0 00010000:00010000:2.0:1788638803.982980:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.982995:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.983005:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638803.983992:0:18943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638803.984144:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788638803.984211:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788638803.984308:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+30:17489:x1875523174290944:12345-192.168.203.34@tcp:58:bash.0 Request processed in 1415us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.984327:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:3.0:1788638803.988232:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638803.988307:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291072 00000100:00100000:2.0:1788638803.988316:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291072 00000100:00100000:2.0:1788638803.988368:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:2.0:1788638803.988376:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+30:17489:x1875523174291072:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638803.988394:0:18942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638803.988410:0:18942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354ba expref: -99 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988699:0:18942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988711:0:18942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 31 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988729:0:18942:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988741:0:18942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 31 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988754:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:2.0:1788638803.988757:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638803.988761:0:18942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 31 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638803.988769:0:18942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7200, rc 0) 00000100:00100000:2.0:1788638803.988861:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17489:x1875523174291072:12345-192.168.203.34@tcp:101:bash.0 Request processed in 486us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638803.988869:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000040:00080000:1.0:1788638804.000021:0:18976:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788638804.000030:0:18976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788638804.000087:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788638804.000095:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788638804.000228:0:18976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18976:1875523183713536:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788638804.000329:0:18976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638804.006252:0:18976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18976:1875523183713536:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788638804.007843:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638804.007956:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291200 00000100:00100000:1.0:1788638804.007964:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291200 00000100:00100000:1.0:1788638804.008009:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:1.0:1788638804.008018:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291200:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788638804.008145:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291200:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638804.008153:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638804.012377:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.012576:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291328 00000100:00100000:2.0:1788638804.012586:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291328 00000100:00100000:2.0:1788638804.012645:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:2.0:1788638804.012655:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738672ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291328:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638804.012706:0:18943:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638804.012832:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738672ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291328:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 179us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.012840:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:2.0:1788638804.016774:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.018598:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291456 00000100:00100000:0.0:1788638804.018613:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291456 00000100:00100000:0.0:1788638804.018728:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:0.0:1788638804.018739:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291456:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.018833:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018851:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018863:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018876:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018883:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018889:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018909:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018930:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.018937:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638804.018974:0:18942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788638804.018978:0:18942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638804.018992:0:18942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019002:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019009:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019015:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019021:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638804.019024:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019031:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019042:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7398420d00) 00010000:00010000:0.0:1788638804.019045:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638804.019050:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019067:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467200/0xa0b1f1e3b4b2c5a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019082:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019089:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019095:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019099:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638804.019102:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019108:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019116:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638804.019118:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638804.019121:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019127:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c5b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019155:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019160:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019171:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019176:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638804.019179:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019185:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019192:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:0.0:1788638804.019195:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638804.019198:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.019203:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.019290:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291456:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 544us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.019299:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:3.0:1788638804.022623:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.024746:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291712 00000100:00100000:2.0:1788638804.024760:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291712 00000100:00100000:2.0:1788638804.024828:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:2.0:1788638804.024837:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+31:17490:x1875523174291712:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638804.024855:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638804.024873:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c5be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354c1 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.024962:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.024977:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.024989:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638804.025018:0:18943:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788638804.026124:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026147:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026154:0:18943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026160:0:18943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638804.026164:0:18943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026172:0:18943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026188:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:2.0:1788638804.026192:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638804.026197:0:18943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026203:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c5c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026255:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c5be lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354c1 expref: 33 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026267:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7398420d00) 00010000:00010000:2.0:1788638804.026270:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638804.026299:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2c5be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354c1 expref: 33 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.026310:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638804.026389:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17490:x1875523174291712:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 1553us (3773us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1788638804.026399:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:3.0:1788638804.029472:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.030011:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174291840 00000100:00100000:2.0:1788638804.030020:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174291840 00000100:00100000:2.0:1788638804.030064:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:2.0:1788638804.030073:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17490:x1875523174291840:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638804.030107:0:18943:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638804.030226:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17490:x1875523174291840:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 153us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.030233:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638804.033742:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.033950:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292096 00000100:00100000:0.0:1788638804.033973:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292096 00000100:00100000:0.0:1788638804.034022:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:0.0:1788638804.034031:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+32:17490:x1875523174292096:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.034052:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638804.034081:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c5d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354c8 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638804.035869:0:18943:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =59 00000004:00080000:0.0:1788638804.035880:0:18943:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788638804.035937:0:18943:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:0.0:1788638804.037453:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c5da lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.037474:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c5da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.037487:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c5da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.037556:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c5d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354c8 expref: 35 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.037592:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c5da lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354c8 expref: 34 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.037601:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3200) 00010000:00010000:0.0:1788638804.037604:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638804.037608:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467800, rc 0) 00000100:00100000:0.0:1788638804.037755:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+34:17490:x1875523174292096:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 3653us (3950us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788638804.037764:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:3.0:1788638804.041629:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.043902:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292352 00000100:00100000:0.0:1788638804.043920:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292352 00000100:00100000:1.0:1788638804.044111:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:1.0:1788638804.044123:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+34:17490:x1875523174292352:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788638804.044258:0:18942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638804.044482:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467800/0xa0b1f1e3b4b2c5da lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354c8 expref: 34 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.044504:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3200) 00010000:00010000:1.0:1788638804.044516:0:18942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638804.045247:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045266:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045830:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045861:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045870:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045877:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045947:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045955:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045961:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045966:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638804.045970:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045978:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.045989:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:1.0:1788638804.045992:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638804.045997:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046013:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309a00/0xa0b1f1e3b4b2c5e8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046026:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046033:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046038:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046043:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638804.046046:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046052:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046059:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc2af51ed (ffff9c7398420a00) 00010000:00010000:1.0:1788638804.046062:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638804.046065:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638804.046070:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2c5ef lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc2af51ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638804.046181:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+33:17490:x1875523174292352:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 2058us (4558us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638804.046189:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:3.0:1788638804.051382:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.051647:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292480 00000100:00100000:0.0:1788638804.051657:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292480 00000100:00100000:0.0:1788638804.051725:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:0.0:1788638804.051736:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+33:17490:x1875523174292480:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.051759:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638804.051780:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c5f6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354cf expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.051987:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.052002:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.052015:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.052118:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c5f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354cf expref: 35 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.052139:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467400/0xa0b1f1e3b4b2c5fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354cf expref: 34 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.052147:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638804.052150:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788638804.052154:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467400, rc 0) 00000100:00100000:0.0:1788638804.052229:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+34:17490:x1875523174292480:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 496us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.052237:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:3.0:1788638804.057160:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.057227:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292736 00000100:00100000:0.0:1788638804.057238:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292736 00000100:00100000:0.0:1788638804.057315:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:0.0:1788638804.057324:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+34:17490:x1875523174292736:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.057409:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.057426:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.057439:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638804.058282:0:18944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788638804.058293:0:18944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567129509752ns, next at 568129507865ns, rc = 0 00000004:00010000:0.0:1788638804.058454:0:18944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d4c73c6 reply state 00000000751eb2bc transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.058465:0:18944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638804.058616:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+36:17490:x1875523174292736:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 1291us (1463us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1788638804.058624:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00010000:00010000:2.0:1788638804.060465:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060481:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060488:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060493:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638804.060498:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060505:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060537:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:2.0:1788638804.060540:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788638804.060547:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.060554:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2c604 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.067515:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.067632:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292864 00000100:00100000:0.0:1788638804.067641:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292864 00000100:00100000:0.0:1788638804.067698:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:0.0:1788638804.067708:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+35:17490:x1875523174292864:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.067730:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638804.067750:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354d6 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.067827:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 36 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.067857:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 36 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.067878:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638804.067881:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638804.067885:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466600, rc 0) 00000100:00100000:0.0:1788638804.067940:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+36:17490:x1875523174292864:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 233us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.067946:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:3.0:1788638804.072606:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.084476:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174292992 00000100:00100000:0.0:1788638804.084491:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174292992 00000100:00100000:0.0:1788638804.084573:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638804.084583:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+5:2364:x1875523174292992:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788638804.084951:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2364:x1875523174292992:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 367us (12351us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788638804.084959:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:2.0:1788638804.093185:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.093427:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174293248 00000100:00100000:0.0:1788638804.093436:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174293248 00000100:00100000:0.0:1788638804.093489:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:0.0:1788638804.093498:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+36:17490:x1875523174293248:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788638804.093744:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+37:17490:x1875523174293248:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 246us (567us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788638804.093752:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:3.0:1788638804.096722:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.096853:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174293504 00000100:00100000:0.0:1788638804.096873:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174293504 00000100:00100000:0.0:1788638804.096964:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:0.0:1788638804.096974:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+37:17490:x1875523174293504:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788638804.100453:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+37:17490:x1875523174293504:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.100470:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:1.0:1788638804.104085:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.115412:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174293632 00000100:00100000:2.0:1788638804.115427:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174293632 00000100:00100000:2.0:1788638804.115504:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:2.0:1788638804.115514:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+37:17490:x1875523174293632:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638804.115543:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638804.115574:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c612 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354dd expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115647:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115662:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115674:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638804.115710:0:18943:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638804.115730:0:18943:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115774:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2c612 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354dd expref: 39 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115807:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354dd expref: 38 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.115817:0:18943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:2.0:1788638804.115820:0:18943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788638804.115824:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:2.0:1788638804.115893:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+38:17490:x1875523174293632:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 379us (11817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.115900:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:1.0:1788638804.123730:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.123855:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174293760 00000100:00100000:2.0:1788638804.123866:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174293760 00000100:00100000:2.0:1788638804.123921:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:2.0:1788638804.123931:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+6:2365:x1875523174293760:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638804.123948:0:19630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638804.123968:0:19630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354e4 expref: -99 pid: 19630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638804.123993:0:19630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c7654, blocks: 0x1 00010000:00010000:2.0:1788638804.124011:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788638804.124015:0:19630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638804.124024:0:19630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 7 pid: 19630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.124063:0:19630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 7 pid: 19630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.124076:0:19630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7c00, rc 0) 00000100:00100000:2.0:1788638804.124123:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2365:x1875523174293760:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 194us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.124130:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:1.0:1788638804.129994:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.130081:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294016 00000100:00100000:2.0:1788638804.130091:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294016 00000100:00100000:2.0:1788638804.130150:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:2.0:1788638804.130160:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+38:17490:x1875523174294016:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638804.130308:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+38:17490:x1875523174294016:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.130315:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:1.0:1788638804.141311:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.141394:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294144 00000100:00100000:3.0:1788638804.141404:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294144 00000100:00100000:3.0:1788638804.141461:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:3.0:1788638804.141472:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+38:17490:x1875523174294144:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788638804.236512:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788638804.236538:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788638804.236581:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:2.0:1788638804.236647:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788638804.236895:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638804.236914:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183713664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788638804.236993:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638804.237061:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183713664 00000100:00100000:0.0:1788638804.237068:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183713664 00000100:00100000:0.0:1788638804.237123:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638804.237365:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183713664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788638804.237517:0:19627:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788638804.237522:0:19627:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788638804.237524:0:19627:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788638804.237526:0:19627:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788638804 -> 1788638804 00002000:00010000:0.0:1788638804.237529:0:19627:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788638804.237588:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183713664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 455us (594us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788638804.237596:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788638804.237619:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788638804.237649:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7391b4b100/2, rc 0, transno 12884901891 00000100:00100000:0.0:1788638804.237655:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183713664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788638804.238131:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+13:17490:x1875523174294144:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 96658us (96826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638804.238210:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:1.0:1788638804.243412:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.244306:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294272 00000100:00100000:3.0:1788638804.244319:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294272 00000100:00100000:3.0:1788638804.244380:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638804.244389:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2364:x1875523174294272:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788638804.244501:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2364:x1875523174294272:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 113us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638804.244526:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:0.0:1788638804.250587:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.250677:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294528 00000100:00100000:3.0:1788638804.250686:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294528 00000100:00100000:3.0:1788638804.250962:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:3.0:1788638804.250974:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+13:17490:x1875523174294528:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788638804.251027:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638804.251055:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2c619 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354dd expref: 13 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.251075:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:3.0:1788638804.251080:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638804.251109:0:18944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.251123:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.251133:0:18944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638804.251401:0:18944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beb9cd31 reply state 000000007c06b969 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.251412:0:18944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638804.251510:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+14:17490:x1875523174294528:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 538us (931us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788638804.251518:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00010000:00010000:3.0:1788638804.255136:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255168:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255177:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255183:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.255188:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255197:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255214:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:3.0:1788638804.255217:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638804.255222:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.255228:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c627 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.257368:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.257467:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294656 00000100:00100000:2.0:1788638804.257478:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294656 00000100:00100000:2.0:1788638804.257582:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:2.0:1788638804.257593:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+7:17490:x1875523174294656:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638804.257609:0:19627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638804.257626:0:19627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354eb expref: -99 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.257666:0:19627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 8 pid: 19630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.257675:0:19627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638804.257679:0:19627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638804.257685:0:19627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.257730:0:19627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 8 pid: 19630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.257744:0:19627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 8 pid: 19630 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638804.257760:0:19627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19627:1875523183713792:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638804.258001:0:19627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638804.267746:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.267815:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294784 00000100:00100000:3.0:1788638804.267863:0:18927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294784 00010000:00010000:3.0:1788638804.267903:0:18927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 9 pid: 19630 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.267952:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:3.0:1788638804.267961:0:18927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+9:2364:x1875523174294784:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638804.267974:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638804.268008:0:18927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 9 pid: 19630 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.268024:0:18927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 9 pid: 19630 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.268048:0:18927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638804.268052:0:19627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006173a969/0xa0b1f1e3b4b2c620 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354e4 expref: 9 pid: 19630 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.268068:0:18927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788638804.268074:0:19627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19627:1875523183713792:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638804.268078:0:18927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.268091:0:18927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.268743:0:19627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.268778:0:19627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7800, rc 0) 00000100:00100000:2.0:1788638804.268886:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+8:17490:x1875523174294656:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 11295us (11526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.268894:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00010000:00010000:2.0:1788638804.273037:0:18927:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 7 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638804.273064:0:18927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:18927:1875523183713920:192.168.203.34@tcp:105: 00000100:00100000:2.0:1788638804.273220:0:18927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638804.276396:0:18927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:18927:1875523183713920:192.168.203.34@tcp:105: 00010000:00010000:2.0:1788638804.276432:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638804.276498:0:18927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2364:x1875523174294784:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 8537us (8760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.276516:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:2.0:1788638804.278525:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.278608:0:19630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174294912 00000100:00100000:3.0:1788638804.278617:0:19630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174294912 00000100:00100000:3.0:1788638804.278712:0:19630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:3.0:1788638804.278723:0:19630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2364:x1875523174294912:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788638804.278959:0:19630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788638804.278963:0:19630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788638804 00002000:00010000:3.0:1788638804.278966:0:19630:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788638802 00002000:00010000:3.0:1788638804.278968:0:19630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788638804 -> 1788638804 00002000:00010000:3.0:1788638804.278971:0:19630:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788638804.279035:0:19630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+8:2364:x1875523174294912:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 313us (517us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788638804.279043:0:19630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638804.282311:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638804.282446:0:19629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295040 00000100:00100000:0.0:1788638804.282466:0:19629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295040 00000100:00100000:0.0:1788638804.282631:0:19629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:0.0:1788638804.282642:0:19629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+8:2365:x1875523174295040:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788638804.282692:0:19629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.282725:0:19629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.282734:0:19629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638804.282739:0:19629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638804.282743:0:19629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.282821:0:19629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.282838:0:19629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.282852:0:19629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19629:1875523183714048:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638804.282930:0:19629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638804.286454:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.286712:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295168 00000100:00100000:2.0:1788638804.286733:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295168 00010000:00010000:2.0:1788638804.286774:0:18928:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 9 pid: 19627 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638804.286839:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:2.0:1788638804.286849:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+9:2364:x1875523174295168:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638804.286867:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638804.286902:0:18928:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 9 pid: 19627 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.286917:0:18928:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 9 pid: 19627 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.286940:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638804.286945:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638804.286951:0:18928:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.286960:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.286982:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638804.287051:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+9:2364:x1875523174295168:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 203us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638804.287058:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:0.0:1788638804.289608:0:19629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000404a044d/0xa0b1f1e3b4b2c62e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354eb expref: 8 pid: 19627 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.289630:0:19629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19629:1875523183714048:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638804.289671:0:19629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289683:0:19629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289690:0:19629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289876:0:19629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289886:0:19629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289894:0:19629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289900:0:19629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638804.289904:0:19629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289912:0:19629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289929:0:19629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.289944:0:19629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2c635 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.290105:0:19629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+7:2365:x1875523174295040:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 7390us (7728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.290115:0:19629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:1.0:1788638804.293593:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.293703:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295424 00000100:00100000:3.0:1788638804.293712:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295424 00000100:00100000:3.0:1788638804.293771:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:3.0:1788638804.293813:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+13:17490:x1875523174295424:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788638804.293891:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.293908:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.293919:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.294342:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.294357:0:18942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 14 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.294365:0:18942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.294402:0:18942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 14 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.294420:0:18942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 14 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.294507:0:18942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183714176:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638804.294736:0:18942:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638804.299669:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.299749:0:18942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183714176:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638804.299773:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295552 00000100:00100000:0.0:1788638804.299795:0:18929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295552 00010000:00010000:0.0:1788638804.299834:0:18929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 15 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.299873:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638804.299882:0:18929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385330c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+15:2365:x1875523174295552:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638804.299896:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638804.299902:0:18929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 15 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299915:0:18929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 15 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299935:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2c60b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354d6 expref: 15 pid: 18943 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299952:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638804.299956:0:18929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299976:0:18929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299983:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.299999:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638804.300007:0:18942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.300022:0:18942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.300029:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638804.300049:0:18929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385330c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+14:2365:x1875523174295552:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.300057:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000001:00080000:3.0:1788638804.300739:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1788638804.301067:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1788638804.301115:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1788638804.301345:0:18942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18942:1875523183714304:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788638804.301398:0:18942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638804.301478:0:18942:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73981c4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638804.301603:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183714304 00000100:00100000:0.0:1788638804.301610:0:18947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183714304 00000100:00100000:0.0:1788638804.302126:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638804.302147:0:18947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18942:x1875523183714304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788638804.302244:0:18947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18942:x1875523183714304:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638804.302251:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638804.302373:0:18942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18942:1875523183714304:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788638804.303072:0:18942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1788638804.303139:0:18942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18942:1875523183714432:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788638804.303180:0:18942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638804.303205:0:18942:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73981c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788638804.303572:0:18948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183714432 00000100:00100000:2.0:1788638804.303580:0:18948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183714432 00000100:00100000:2.0:1788638804.303624:0:18948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638804.303633:0:18948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18942:x1875523183714432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788638804.303830:0:18948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18942:x1875523183714432:12345-0@lo:1000:mdt00_000.0 Request processed in 197us (648us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788638804.303838:0:18948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638804.303926:0:18942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bce1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18942:1875523183714432:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788638804.304026:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304036:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304042:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304057:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.304061:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304069:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304084:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:3.0:1788638804.304087:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638804.304092:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304098:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c643 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304129:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304201:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304207:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304211:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.304214:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304312:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304332:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:3.0:1788638804.304335:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638804.304341:0:18942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 17 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304352:0:18942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 17 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304360:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 17 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.304389:0:18942:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2c5a2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354ba expref: 17 pid: 18942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.304400:0:18942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bce1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183714560:192.168.203.34@tcp:105: 00000100:00100000:3.0:1788638804.304511:0:18942:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73981c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788638804.320088:0:18942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bce1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18942:1875523183714560:192.168.203.34@tcp:105: 00010000:00010000:3.0:1788638804.320120:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.320132:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6200/0xa0b1f1e3b4b2c59b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.320163:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.320178:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.320204:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.320216:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321177:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321185:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321190:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.321195:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321202:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321217:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:3.0:1788638804.321228:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638804.321232:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321238:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c64a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321251:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321257:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321273:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321278:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.321281:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321287:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321295:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:3.0:1788638804.321297:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638804.321300:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.321306:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c63c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638804.321812:0:18976:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788638804.321817:0:18976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638804.321844:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788638804.321851:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788638804.322197:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17490:x1875523174295424:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 28413us (28608us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1788638804.322208:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 60 00000020:00080000:3.0:1788638804.322213:0:18942:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788638804.322434:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.323416:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295680 00000100:00100000:3.0:1788638804.323427:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295680 00000100:00100000:3.0:1788638804.323476:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638804.323484:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17489:x1875523174295680:12345-192.168.203.34@tcp:49:bash.0 00000100:00100000:3.0:1788638804.324122:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17489:x1875523174295680:12345-192.168.203.34@tcp:49:bash.0 Request processed in 635us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638804.324318:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638804.325075:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.325160:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174295936 00000100:00100000:2.0:1788638804.325167:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174295936 00000100:00100000:2.0:1788638804.325216:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:2.0:1788638804.325225:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+17:17490:x1875523174295936:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788638804.325914:0:18945:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788638804.326130:0:18945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1788638804.326175:0:18945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326194:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326206:0:18945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326216:0:18945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326223:0:18945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326229:0:18945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638804.326299:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788638804.326381:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+19:17490:x1875523174295936:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 1155us (1306us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1788638804.326389:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000020:00080000:2.0:1788638804.326393:0:18945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788638804.328515:0:18930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638804.328595:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.328605:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638804.328625:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.328635:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.328653:0:18930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c73862a3a00) 00010000:00010000:0.0:1788638804.328657:0:18930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788638804.328661:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.328668:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2c651 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638804.328683:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638804.328684:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638804.328686:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638804.330933:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.331056:0:20262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174296064 00000100:00100000:3.0:1788638804.331066:0:20262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174296064 00000100:00100000:3.0:1788638804.331124:0:20262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:3.0:1788638804.331143:0:20262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+7:17489:x1875523174296064:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638804.331161:0:20262:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638804.331181:0:20262:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2c658 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354f2 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638804.331208:0:20262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9c7654, atime: 0x6a9c7652, ctime: 0x6a9c7654, blocks: 0x1 00010000:00010000:3.0:1788638804.331229:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788638804.331234:0:20262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638804.331243:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2c658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354f2 expref: 8 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.331260:0:20262:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2c658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354f2 expref: 8 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.331273:0:20262:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638804.331334:0:20262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f354e72a-acd9-4a93-bd80-84ba26e24288+8:17489:x1875523174296064:12345-192.168.203.34@tcp:101:bash.0 Request processed in 201us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638804.331341:0:20262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:1.0:1788638804.334692:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638804.334922:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174296320 00000100:00100000:2.0:1788638804.334933:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174296320 00000100:00100000:2.0:1788638804.335059:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:2.0:1788638804.335069:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+19:17489:x1875523174296320:12345-192.168.203.34@tcp:35:bash.0 00000001:00080000:2.0:1788638804.335387:0:18945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:2.0:1788638804.335663:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+21:17489:x1875523174296320:12345-192.168.203.34@tcp:35:bash.0 Request processed in 594us (978us total) trans 12884901928 rc 0/0 00000100:00100000:2.0:1788638804.335672:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000020:00080000:2.0:1788638804.335677:0:18945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788638804.427639:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.427829:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174296576 00000100:00100000:3.0:1788638804.427839:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174296576 00000100:00100000:3.0:1788638804.427891:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:3.0:1788638804.427901:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+21:17500:x1875523174296576:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638804.427934:0:18944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638804.427953:0:18944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c65f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14354f9 expref: -99 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638804.428034:0:18944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788638804.428160:0:18944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c65f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354f9 expref: 23 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.428176:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73862a3400) 00010000:00010000:3.0:1788638804.428179:0:18944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638804.428184:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c65f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14354f9 expref: 23 pid: 18944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.428199:0:18944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030400, rc 0) 00000100:00100000:3.0:1788638804.428262:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f354e72a-acd9-4a93-bd80-84ba26e24288+22:17500:x1875523174296576:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 362us (633us total) trans 12884901929 rc 301/301 00000100:00100000:3.0:1788638804.428269:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:0.0:1788638804.437673:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.437756:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174296704 00000100:00100000:3.0:1788638804.437766:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174296704 00000100:00100000:3.0:1788638804.437855:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:3.0:1788638804.437865:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+22:17500:x1875523174296704:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:3.0:1788638804.437937:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.437954:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.437966:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.437995:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438002:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438009:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438244:0:18942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438253:0:18942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438260:0:18942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638804.438298:0:18942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438311:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438317:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438324:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438330:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.438334:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438347:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438641:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7393e81900) 00010000:00010000:3.0:1788638804.438644:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638804.438648:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438654:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2c66d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438667:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438674:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438680:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438684:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.438687:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438692:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438700:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c7393e81b00) 00010000:00010000:3.0:1788638804.438702:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638804.438705:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438722:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031600/0xa0b1f1e3b4b2c674 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438736:0:18942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438742:0:18942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438747:0:18942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438751:0:18942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638804.438754:0:18942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438761:0:18942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438768:0:18942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c738a6e9c00) 00010000:00010000:3.0:1788638804.438770:0:18942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638804.438773:0:18942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638804.438779:0:18942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031000/0xa0b1f1e3b4b2c67b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638804.438941:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f354e72a-acd9-4a93-bd80-84ba26e24288+22:17500:x1875523174296704:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 1074us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638804.438949:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:1.0:1788638804.440988:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638804.441054:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174296960 00000100:00100000:3.0:1788638804.441063:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174296960 00000100:00100000:3.0:1788638804.441112:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638804.441122:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+22:17500:x1875523174296960:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638804.441520:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f354e72a-acd9-4a93-bd80-84ba26e24288+23:17500:x1875523174296960:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 398us (538us total) trans 12884901930 rc 0/0 00000100:00100000:3.0:1788638804.441528:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:2.0:1788638804.640224:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638805.665985:0:18930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638805.729951:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183714688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638805.730023:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638805.730279:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183714688 00000100:00100000:3.0:1788638805.730288:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183714688 00000100:00100000:3.0:1788638805.730483:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638805.730493:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183714688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638805.730538:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788638805.730658:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183714688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638805.730666:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788638805.731779:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638805.731873:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183714688:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788638806.262739:0:21110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:0.0:1788638806.367949:0:18976:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788638806.367959:0:18976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638806.367989:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788638806.367997:0:18976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788638806.688326:0:18931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638807.265326:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638807.265404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638807.265513:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183714816 00000100:00100000:0.0:1788638807.265521:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183714816 00000100:00100000:0.0:1788638807.265615:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638807.265625:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183714816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638807.265660:0:19632:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638807.265713:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183714816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638807.265720:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788638807.265771:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638807.267389:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638807.276081:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183714944:0@lo:400:kworker.0 00000100:00100000:1.0:1788638807.276677:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183715072:0@lo:400:kworker.0 00000100:00100000:1.0:1788638807.276726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638807.276824:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638807.276865:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183714944 00000100:00100000:0.0:1788638807.276872:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183714944 00000100:00100000:0.0:1788638807.276914:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788638807.276924:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3294:x1875523183714944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638807.276972:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83477f13-c5f9-4c4e-acd2-08466075bc00+19:3294:x1875523183714944:12345-0@lo:400:kworker.0 Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638807.276980:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788638807.277023:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83477f13-c5f9-4c4e-acd2-08466075bc00:3294:1875523183714944:0@lo:400:kworker.0 00000100:00100000:0.0:1788638807.277648:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183715200:0@lo:400:kworker.0 00000100:00100000:0.0:1788638807.277679:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638807.278952:0:19627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183715072 00000100:00100000:3.0:1788638807.278963:0:19627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183715072 00000100:00100000:3.0:1788638807.279018:0:19627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788638807.279026:0:19627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183715072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638807.285700:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183715200 00000100:00100000:2.0:1788638807.285710:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183715200 00000100:00100000:2.0:1788638807.285764:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638807.285774:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183715200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638807.285923:0:19627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183715072:12345-0@lo:400:kworker.0 Request processed in 6893us (9192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638807.285934:0:19627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638807.285950:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183715200:12345-0@lo:400:kworker.0 Request processed in 175us (8267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638807.285958:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788638807.285972:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638807.286091:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183715456:0@lo:400:kworker.0 00000100:00100000:2.0:1788638807.286141:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638807.286181:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638807.286187:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ae1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183715328:0@lo:400:kworker.0 00000100:00100000:2.0:1788638807.286210:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638807.286234:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183715456 00000100:00100000:2.0:1788638807.286238:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183715456 00000100:00100000:3.0:1788638807.286800:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183715328 00000100:00100000:3.0:1788638807.286805:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183715328 00000100:00100000:3.0:1788638807.286831:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788638807.286838:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638807.286896:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183715456:12345-0@lo:400:kworker.0 Request processed in 58us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638807.286905:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788638807.286919:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788638807.286925:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ae1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183715328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638807.286951:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ae1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183715328:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638807.286957:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788638807.286976:0:18938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638807.287555:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183715200:0@lo:400:kworker.0 00000100:00100000:2.0:1788638807.287604:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183715328:0@lo:400:kworker.0 00000100:00100000:2.0:1788638807.287615:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183715456:0@lo:400:kworker.0 00000100:00100000:1.0:1788638807.290182:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ae1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183715072:0@lo:400:kworker.0 Debug log: 9790 lines, 9790 kept, 0 dropped, 0 bad.